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Preface 


This handbook is Volume II in a series devoted to stationary partial differential equations. 
Similarly as Volume I, it is a collection of self-contained, state-of-the-art surveys written 
by well-known experts in the field. 

The topics covered by this handbook include existence and multiplicity of solutions of 
superlinear elliptic equations, bifurcation phenomena, problems with nonlinear boundary 
conditions, nonconvex problems of the calculus of variations and Schrédinger operators 
with singular potentials. We hope that these surveys will be useful for both beginners and 
experts and speed up the progress of corresponding (rapidly developing and fascinating) 
areas of mathematics. 

We thank all the contributors for their clearly written and elegant articles. We also thank 
Arjen Sevenster and Andy Deelen at Elsevier for efficient collaboration. 
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The Dirichlet problem for superlinear elliptic equations 3 
0. Introduction 


Boundary value problems for nonlinear elliptic partial differential equations have been 
a major focus of research in nonlinear analysis for decades. In this survey we discuss 
semilinear equations like 


a x€E 82, (0.1) 


u=0 on 02, 


where @ is a domain in R%, N > 2, and f:82 x R— R is superlinear, that is, 
f(x, t)/t — ow as |t| > oo. The model nonlinearity is the homogeneous function 


f(x,t) = |t/?-7t with p > 2. (0.2) 


The continuation method or other classical methods based on the Leray—Schauder de- 
gree do not apply easily to (0.1) because there are no a priori bounds for the solutions. 
This is inherent to superlinear nonlinearities. In fact, for the model nonlinearity (0.2) with 
p>2, p <2N/(N — 2) if N > 3, a € L™ (2), and bounded , there exist infinitely 
many solutions which are unbounded in the H! norm. On the other hand, if 2 4 R% is 
star-shaped, a(x) = const > 0, f is as in (0.2) with p >2N/(N — 2), N > 3, then (0.1) 
has no solution except the trivial one u = 0. Here we know a posteriori that the solutions 
are bounded but the Leray—Schauder methods do not apply due to a lack of compactness. 

After some initial work during the 1960s and early 1970s, Ambrosetti and Rabinowitz 
established in the seminal paper [5] several variational methods to obtain solutions of (0.1) 
on bounded domains, most notably the mountain pass theorem and variations thereof. 
These methods have been refined and extended to deal, for instance, with unbounded do- 
mains or the critical exponent case f(x,t) = b(x)|t|*/ (N—2)¢ which is closely related to 
the Yamabe problem from differential geometry. With these methods more complicated 
partial differential equations with variational structure can now be investigated. Moreover, 
qualitative properties of the solutions have been discovered in recent years, in particular, 
on the nodal structure and the symmetry of the solutions. 

The goal of this chapter is to present some basic ideas in a simple setting and to survey 
selected results on the Dirichlet problem (0.1) with superlinear nonlinearity. The chap- 
ter consists of three sections. In Section | we deal with positive solutions of (0.1), in 
Section 2 with sign-changing solutions on bounded domains and in Section 3 we treat 
the unbounded domain 2 = R%. No effort is being made to be as general as possible. 
Neither did we try to write a comprehensive survey on (0.1). For example, we do not 
present results on the bifurcation of solutions nor for the p-Laplace operator, nor do we 
treat singularly perturbed equations in detail. These topics require separate surveys. For- 
tunately, there are a number of well written monographs about (0.1) where the reader can 
find additional information and further references. We would like to mention the books by 
Rabinowitz [79], Struwe [87], Chang [41], Ghoussoub [52], Kavian [56], Schechter [81], 
Willem [95], Chabrowski [39,40], Kielh6fer [57]. We concentrate on topics not being cov- 
ered in these monographs, although a certain overlap cannot be avoided for natural reasons. 
Of course, the choice of topics is also influenced by our own research interests. 
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0.1. Conditions on the nonlinearity 


For the convenience of the reader we list here conditions on f which we use at various 
places in the chapter. The critical exponent is defined by 


too if N=2, 
wa UN 23. 
Given f:2 x R—> Rwelet F:2 x R-R, FQ, t):= fs Ff (x, 5) ds, be the primitive 
of f. 
(fo) f:8 x R— Ris a Carathéodory function with f(x, ft) = o(t) as t > 0. There 
exist C > 0 and p < 2* such that | f(x, 1)| < C(|t} + |¢|?~!) for all x € Q,teER. 
(f5) f :2 x R— R is differentiable in t € R, and the derivative f, is a Carathéodory 
function with f;(x,0) = 0. There exist C > 0 and p < 2* such that | f;(x,1)| < 
C(1+ |t|?~*) for allx € 2,1 ER. 
(f,) For every x € 2 the function R \ {0} — R, th f(x, t)/|t], is strictly increasing. 
(f}) frlx,t) > f(x, t)/t for every x € Q and every t £0. 
(f2) There exist R > 0 and @ > 2 such that 0 < 0F (x,t) < f(x, t)t for all x € 2, 
|t} > R. If 2 =RN it is required that R = 0. 
(f3) limy:|+00 F (x, t)/t? = +00, uniformly in x. 
(f4) There exists m > 0 so thattt> f(x, t) + mt is strictly increasing for all x € 92. 
(f5) infizo f(x, t)/t > —oo. 


1. Positive solutions 
1.1. Existence of positive solutions 
We consider first the problem 


—Aut+a(x)u=uP!, x EQ, 
u>O0O, xEQ, (1.1) 
u=0 on 082, 


where 2 is a smooth domain in R‘, a € L©(Q) and 2 < p < 2*. In order to obtain a 


solution of (1.1) we assume that —A + a is positive, i.e., there exists c > 0 such that, for 
every u € HA (2), 


[ iuP aconPar > e f u> dx. (1.2) 
Q Q 


Our main tool is the Rellich compactness theorem. 


THEOREM 1.1. Let 92 be bounded and let 1 < p < 2*. Then the injection Hy} (2) Cc 
LP? (82) is compact. 
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THEOREM 1.2. Assume that 92 is bounded, 2 < p < 2* and (1.2) is satisfied. Then there 
is a solution of (1.1). 


PROOF. By Theorem 1.1 and lower semicontinuity, it is easy to verify that 


w= inf [iver acres (1.3) 
veHd (2) Q 
lull pp=l 


is achieved by some v. After replacing v by |v|, we may assume that v > 0. It follows from 
the Lagrange multiplier rule that 


—Ad+a(x)d = pr? !. 


A solution of (1.1) is then given by 7 = w!/?-)d. Indeed, 7 > 0 on Q by the strong 
maximum principle. 


REMARK 1.3. There are other ways to prove Theorem 1.2. Instead of minimizing as 
in (1.3) one can minimize the functional 


1 2 4 1 
@(uy== | |Vulo +a(x)uedx —— | |u|? dx 
2J2 PJ2Q 
on the Nehari manifold 
N = {u€ Hj(@): u #0, ®'(u)u =0} 
- {ue Hi(ay u #0. f [Vu +acudx = f wi? ax], 
Q Q 


A critical point of the constrained functional ®|,7 is a critical point of ®, hence a solution 
of (1.1). The map, 


1/(p—2) 
{v € Hg(2): llullarp = 1} +N, UR (/ IVul? + ata)v? dr) v, 
2 


is a diffeomorphism with inverse 


N => {ve HA(2): llvllze = 1}, . 
ee llullze 


It maps the minimizer v of (1.3) to the minimizer u of on N. The solution can also be 


obtained via the mountain pass theorem from [5]. In fact, 


@(u) = inf max @(tu) = inf max P(y(t)), 
uA0 t>0 yer te[0,1] 
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where I” consists of all continuous paths y:[0,1] > Ay (2) with y(O) =O and 
®(y(1)) <0. These three different approaches are equally valid for (1.1). They allow 
different generalizations. The mountain pass approach leads to the most general existence 
results for positive solutions of —Au + a(x)u = f(x, u) with Dirichlet boundary condi- 
tions. This approach is most widely used in the literature. Minimizing over the Nehari 
manifold requires more conditions on the nonlinearity {. When these are satisfied one can 
find nodal solutions on the Nehari manifold and obtain useful additional information, in 
particular on the nodal structure and the symmetry. Minimizing as in (1.3) only makes 
sense for homogeneous nonlinearities. 


The critical case p = 2* and the supercritical case p > 2* are more delicate. 


THEOREM 1.4. Suppose that N >3, p > 2*, 2 £RN is star-shaped with smooth bound- 
ary, and a(x) =i > 0. Then there is no solution of (1.1). 


PROOF. By the Pohozaev identity [78], if 


ee ft) ing, 
u=0 on 022, 


then 


N-2 2 1 2 
N | F(u)dx — —— [Vul- dx = = |[Vu|“o - vdo, 
Q 2 Je 2 Jaa 


where F(u) = ch f(s) ds and v denotes the unit outward normal to 092. For a solution u 
of (1.1) we therefore obtain 


N N-2 Vul? 
-»f wax (2 - 5") fw |? dx i | a o-vdo >0. 
Q 


It follows that u = 0 or A <0, hence 4 = 0. If 2 = 0, then p = 2* and Vu = 0 on 0, so 


by (1.1) 
o=-| Audx = fu?" dr, 
Q Q 


and therefore, u = 0. 


REMARK 1.5. In the situation of Theorem 1.4, there is, in fact, no positive nor sign- 
changing solution u 4 0 of 


= = |y|P72 
Au+aAu= |u| u, xE, (1.4) 


u=0 ono. 


As in the proof of Theorem 1.4, for a solution u 4 0 to exist we must have A = 0, p = 2*, 
and then Vu = 0 on 092. Now u = 0 follows from the unique continuation principle. 
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We assume now that {2 is bounded and a(x) = —A, where 0 < A < A1(S2) and 


A4(2) = min [iverar. 
veHd (2) Q 
lull -2=1 


We consider the minimization problem 


= inf [iver — Av? dx. (1.5) 
veHd (2) 
ell oe = 1 


In order to solve this problem, we need two tools: the following Brezis—Lieb lemma 
from [31] and the strict inequality S, < S, where 


S= inf i |Vul? dx. 
veH| (RN) JRN 


ell ox =I 


LEMMA 1.6. Let (un) be a bounded sequence in L?(92), 1 < p < &, such that u, > u 
a.e. on 82. Then 


Jim (lunllZ» = |lun — ullZ>) = llellzp- 
LEMMA 1.7. Let N >4 and i> 0. Then S), < S. 


PROOF. The instanton 


[N(N — 2)1\%-2/4 


SO = TE PIO 


(1.6) 


is a minimizer for S. Since U|o ¢ Hy (2), we have to use a truncation yw. We can assume 
that By (0) C 922. Let w € D(Q), w FO, be such that wy = 1 on B, (0). Using 


Us(x) = wens Py (=) 


an asymptotic analysis shows that S, < S. 


REMARK 1.8. When N = 3, the situation is more delicate. Consider the unit ball 2 = 
B, (0) C R?. Then we have 


A1(2) 


O<A< 
4 
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and 


Ai(2) 
4 


<A<),)(2) = S<S. 


The next result is due to Brezis and Nirenberg [32]. 


THEOREM 1.9. Let N >4, p=2*,0 <2 <A 4(Q) and a(x) = —A. Then S), is achieved 
and there exists a solution of (1.1). 


PROOF. Let (v,) C Hy ($2) be a minimizing sequence for S): ||vp || ,2* = 1, 
/ |Vun|? — Ave dx > S). 
Q 


By Rellich’s theorem, we can assume, going if necessary to a subsequence: 


Un vin Hg (2), 
vn > v_ in L?(2), 


Un —>v- ae.on 2. 
With p = 2* and wy, = vp, — v, we obtain from Lemma 1.6, 
. Pp —_ Pp 
1— (jim, Wally p = lle. 
It follows that 
5, = f vor —avax+ lim [ivunPas 
n—-> oo 
> Sllullze +S lim |lwall7r 
noo 
= Syllull2> + S(1— [ull?,) 7” 
= Sallullze + S(U— Mullen)”. 


Since, by Lemma 1.7, S, < S, necessarily lve, = | and v is a minimizer for S,. As 
before, (1.1) is solvable. 


The case A = 0 and p = 2* is more complicated. Using the instantons U,,y(x) = 
e?-)/2U((x — y)/e) with U from (1.6) one shows that the infimum Sp in (1.5) is not 
achieved on a domain §2 4 RY (see, e.g., [95], p. 32). Bahri and Coron [8] showed that the 
topology of the domain plays an important role. 


THEOREM 1.10. Suppose 2 CRN is a bounded domain with nontrivial topology in 
the sense that it has a nontrivial homology group Hi(82; Z2) #0 for some k > 1. Then 
(1.1) with a(x) =0 and p = 2* has a solution. 
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We now consider the case 2 = R%, a(x) = 1, 2 < p < 2* and the boundary value 
problem 


—Autu=u? onR, 
u>O0O on RN, (1.7) 


u(x) > 0, |x| > oo. 


The corresponding minimization problem is 


Sp= inf / [Vol + v* dx. 
veH|(RN) JRN 
lullpp=l 


Let us recall that H!(R) = Hy (IR). We shall use the Schwarz symmetrization and radial 
Sobolev inequalities. 

Let Vy = m(B,(0)) be the Lebesgue measure of the unit ball in IR. The Schwarz 
symmetrization of a measurable subset A of R is defined by 


A* = Br(O),_ where R is given by m(Br(O)) = Vy RN =m(A). 
The Schwarz symmetrization of a measurable function u: RR‘ —> [0, oof is defined by 
u*(x) = sup{t >0: xe {u> Ey} 


THEOREM 1.11. Let u:IR™ — [0, oof be measurable and let f :[0, 0o[ > R be continu- 
ous. Then 


i- Fut)ax= f f(u)dx. 


Let 1 < p<ooandue€ W!?(R), u > 0. Then the Pélya-Szegé inequality holds: 
|| Vu" > <Vullze. 


See [34] or [96] for a simple proof. 

We denote by H} (RY) the space of radial functions of H 1(R%). Let us recall that a 
function u is radial if uv = u(|x|). The Schwarz symmetrization of a measurable function is 
radial. 

The following results are due to Strauss [85]. 


LEMMA 1.12. Let N > 2. There exists c(N) > 0 such that, for every u € H} (RY), 


Piva? |x[0-M2 ae. onR, 


|u(x)| <c()|lull ie 


THEOREM 1.13. Let 2 < p < 2*. Then there is a radial solution of problem (1.7). 
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PROOF. Let (v,) C H!(R%) be a minimizing sequence for Sp: |lvallar = 1, 
/ [Vun|? + ue dx > Sp. 
RY 


By Theorem 1.11, we can replace (v,) by (v7). By Theorem 1.1 and Lemma 1.12, we can 
assume, going if necessary to a subsequence: 


ve =v in A(R), 


ve>v inL?(R), 


where v is a radial function. Clearly, v is a minimizer for S, and (1.7) is solvable. 


The existence of nonradial entire solutions u € H!(R) of (1.1) and more general equa- 
tions will be discussed in Section 3. 


1.2. Uniqueness of positive solutions 


The problem of uniqueness of positive solutions is mostly solved for symmetric domains 
and is closely related to the symmetry of solutions. Let us first recall a celebrated result 
proved in 1979 by Gidas, Ni and Nirenberg [53]. 


THEOREM 1.14. Let Q be the unit ball in RN. Assume that f is C! and ué C2(Q2) 
satisfies 


—Au=f(u), xE, 
u>0, xe, 
u=0 on 082. 


Then u is a radial function and u'(r) is negative. 
Consider the problem 


—Autidu=uP!, xE€Q=B,(0), 
u>O0O, xEQ, (1.8) 
u=0 on 022, 


where §2 = B(0) is the unit ball in R’ . Uniqueness is proved when 


4=0,2 <p <2", Gidas, Ni and Nirenberg [53], 1979, 
A>0,2 <p <2*, Kwong [59], 1989, 
A<0,2<p<2"*, Srikanth [84], 1993. 
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Concerning problem (1.7), uniqueness for 2 < p < 2* is proved in [59] after the pioneering 
work of Coffman [42] in 1972. 

The situation differs when $2 is an annulus, Q = {x € R™: r < ||x|| < R} for some 
R>r-> 0. Let us recall a particular case of the principle of symmetric criticality proved 
in 1979 by Palais. 


DEFINITION 1.15. The action of a topological group G on a normed space X is a contin- 
uous map 


Gx X— X:(g,u) > gu 
such that 


l-u=u, 
(gh)u = g(hu), 


ut> gu is linear. 


The action is isometric if || gu|| = ||u||. The orbit of an element u € X is the set Gu := 
{gu: g © G}, and the space of fixed points is defined by 


Fix(G) = {ue X: gu=u forall g¢ G}={ue X: Gu={u}}. 
A function gy: X — R is invariant if g o g = g for every g EG. 


EXAMPLE 1.16. Assume that £2 is invariant by rotations: for every g € SO(N), g2Q= 92. 
The action of SO(N) on Hy (2) is defined by 


gu(x) = u(g! )e 


The space Fix(SO(N)) is the space Hy,.(2) of radial functions in Hy (2). From Theo- 
rem 1.1 and Lemma 1.12, it follows that the injection Hy, (2) Cc LP(s2) is compact for 
2 < p < 2*. Moreover, if 2 is an annulus 


Q={xeR*: p<\|x|<R} 
or an exterior domain 
Q={xeR™: p<|xl}, 
the injection Ho, Cc L?(Q2) is compact for 2 < p < oo. 


Let us recall that, for every open subset 2 of R, 


S(Q):= inf 
uch (2) 
Ill =1 


|Vulls = 8 
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and S(S2) is never achieved except when 2 = RY. 
Since the “radial infimum” is achieved when 2 is an annulus, we have 


: 2 : 2 
S= inf Vul2,<m2,= min |Vulo. 
eH} (2) ueHd (2) 
Fa 
lw oe =l Well x=! 
We deduce 
p= min |\Vulli,<ppr= min ||Vull;, for2*-e<p<2". (19) 
ueHd (2) wed (2) 
lip p= llellpp=l 


Using the symmetric criticality principle, we construct, for 2 < p < o, a radial solution 
of the problem 


—Au=u?P—!, xeQ={xeR: r < |x] < R}, 
u>O0, xEQ, (1.10) 
u=0 on 082. 


For 2* — ¢ < p < 2* inequality (1.9) yields a nonradial solution of problem (1.10). Thus 
we have proved the following theorem. 


THEOREM 1.17. For 2* — € < p < 2*, problem (1.10) has at least two solutions, one 
radial and one nonradial. Moreover, the least energy solution is nonradial. 


The above result is due to Brezis and Nirenberg [32]. Following their work, there are 
related results for multiple positive nonradial solutions of semilinear elliptic equations on 
expanding annular domains, by Coffman [43] for N = 2, by Li [62] for N > 4, and by 
Byeon [35] (and Catrina and Wang [38] independently) for N = 3. We set 92g = {x € 
RY: a < |x| <a +1} and consider 


—Autu=uP!, xE Qa, 
u>0, x€EQaq, (1.11) 
u=O0O, x €d02g, 


where N >2,2 <p <2*. 


THEOREM 1.18. The number of not rotationally equivalent, nonradial solutions of (1.11) 
tends to infinity as a > oo. 


In [38] the exact symmetry of these nonradial positive solutions was examined and pos- 
itive solutions having a prescribed symmetry can be constructed from a local minimization 
procedure. The article [93] has results for the critical exponent problems. More results on 
multiple positive solutions will be mentioned in Section 1.6. 
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1.3. The Nehari manifold 


Let 2 C RN be a (not necessarily bounded) smooth domain. We consider the problem 


Ceo xe 2, (1.12) 


u=0 on 02, 
where a € L™(S2). Concerning the nonlinearity we assume: 
(fo) f:982xR— Risa Carathéodory function with f(x, t) = o(f) as t > 0, uniformly 
in x. There exist C > 0 and p < 2* such that | f(x, f)| < C(|t| + |t|/?7!) for all 
xE2,teER. 


(f,) For every x € 2 the function R \ {0} ~ R, th f(x, f)/|tI, is strictly increasing. 
By (fo) the functional 


1 
®:E=Hj(2)>R, ow=; Val? +acayu? dx — f F(x, u)dx, 
2 2 


where F(x, t) = fs f (x, s) ds, is well defined and C ! Critical points of ® are weak solu- 
tions of (1.12). The Nehari manifold is defined by 


N= {ue E\ {0}: & (uu =0}. 
We define also 


N: 


={ueN: +u>0} and Bs. = inf{ (uv): ueN+}. 


It is clear that VV contains all nontrivial critical points of &. Moreover, in order to find the 
least energy positive (resp. negative) solution of (1.12), it suffices to minimize ® on Ny 
(resp. N_). 

We begin with a geometric description of MN’. We assume that f satisfies (fo) and (f;), 

or the following differentiable versions: 

(f6) f:2 x R— R is differentiable in t €¢ R with f(x, t) = 0(t) as t > 0, uniformly 
in x. The derivative f; is a Carathéodory function. There exist C > 0 and p < 2* 
such that | f;(x, t)| <C(1 + |t|?77) for all x € 2, teER. 

(f}) fi(x,t) > f(x, t)/t for every x € Q and every t £0. 

Clearly, (£4) and (f;) imply (fo) and (f,). For u € SE := {u € E: ||u|| = 1}, the map, 


Wu :-Rt SR, 
(1.13) 
1, _ 2 2 f (x, Au) 
AR -@' (Au)u= |Vul“ + a(x)u* dx — —udx, 
Xr Q Q Xr 


is strictly decreasing by (f;). The set 


U:= {u ESE: w,(A) < 0 for some A > 0} 
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is an open subset of SE. For u € U there exists a unique A, > 0 such that w,(A,u) = 0, 
that is, A,uw EN. 


PROPOSITION 1.19. (a) If f satisfies (fo) and (£1) then the map 
h:uU>WN, Ur> Ayu 
is a homeomorphism with inverse N > U, vt v/||v|l. 

(b) If f satisfies (£5) and (f;) then N is a C!-manifold with tangent space T,.N = 
{v € E: ®”(u)[u, v] + ®'(u)v = 0}. The map h is a C!-diffeomorphism. If u € N is a 
critical point of the constrained functional ®| yy, then u is a critical point of ®. 

PROOF. (a) is a simple consequence of the fact that w, is strictly decreasing and that 
wW, (A) 1s continuous in (u, A). 


(b) Here ® € C?(E) and the implicit function theorem applied to the map 


UxR*, (u, A) > Wula) 


yields that ut> A, is C ! The claims follow because T,V is transversal to R*w. 


We can describe the set U if f is superlinear: 
(f2) There exist R > 0 and @ > 2 such that 0 < @F (x,t) < f(x, t)t for all x € Q, 
|t| > R. 


LEMMA 1.20. Suppose (fo), (f1) and (f2) hold. Then U = {u € SE: Q(u) > O}, where 
Q(u) := fo(Vul? + a(x)u*) dx. If —A +a is positive then U = SE and N is bounded 
away from 0. 


The easy proof is left to the reader. 


THEOREM 1.21. If (fo) and (f,) hold then B+ = infyeyy B(u) = 0 and every minimizer of 
® on Nx (resp. N_) is a positive (resp. negative) solution of (1.12). 


We do not claim that 64 is achieved. This requires additional conditions on f and a; 
see Theorem 1.23. Since NV is not, in general, a differentiable manifold, the Lagrange 
multiplier rule is not applicable. We shall use a general deformation lemma. By definition 
&¢ = &~!(J—ov, c]) and Ss = {u € X: dist(u, S) < 5}. 


LEMMA 1.22. Let X be a Banach space, ® € C'!(X,R), SC X,c€R,e>0,5>0, such 
that 


Vue @'([c—2e,c+2e])N S25: |] Sw) || > 


Then there exists n € C({O, 1] x X, X) such that 
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Gi) ift=Oorifu¢g @—!([c — 2e, c+ 2e]) N So then n(t,u) =u; 
(ii) nO, BSTENS) COW®; 
(iii) n(t, -) is a homeomorphism of X Vt € [0, 1]; 
(iv) ||n(t,u) —ul| <6 Vue X, Vt € [0, 1]; 
(v) ®(n(, u)) is nonincreasing Vu € X; 
(vi) ®(n(t,u)) < c Vu € © Ss, Vt € [0, 1]. 


A proof can be found in [95], Lemma 1.4. 


PROOF OF THEOREM 1.21. The inequality 6. > 0 follows from the fact that the map y, 
from (1.13) is strictly decreasing. Now let u € N’* be such that (uw) = B,. We shall prove 
that &’(u) = 0. 

It follows from assumption (f;) that 


@P(su)< @(u)=f, forO<sFl. 
If &’(u) $ 0, then there exists 6 > 0 and A > 0 such that 
lv—ul] <35 = > Ov) >A. 
Clearly Bo = max{@(u/2), B(3u/2)} < B,. For ¢ = min{(6+ — Bo)/2, (Ad)/8} and 
S = Bs(u), Lemma 1.22 yields a deformation 7 such that 
o n(1,v)=vifv¢ d-'(, —2e, By +2¢)), 
e n(l, BF++* FQ Bu, 5)) C BA+-*, 
e @(n(1, v)) < @(v) for all ve Hj (&). 
Let us define, for 1/2 < s < 3/2, 
h(s) =max{n(1, su), 0} € Hy (2). 


It is clear that 


®(h(s)) < By. 


max 
1/2<s<3/2 


We shall prove that h((1/2,3/2]) ANT #9, contradicting the definition of B,. Since 
j 1 1 1 _j,fu 
Ph h ==@ u>0O, 
2 2 2 2 
o'(n(2)\a(2) =20°( Ju <o, 
2 2 2 2 


the existence of s € (1/2, 3/2) with ®’(h(s))h(s) = 0, ie., h(s) € N™, follows from the 
intermediate value theorem. 
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1.4. Existence of ground states 


In order to prove the existence of a minimizer of ® on NV, we assume 
(f3) limj|+00 F(x, t)/t? = +00, uniformly in x. 


THEOREM 1.23. Suppose that 2 is bounded and that f satisfies (fo) with p < 2*, 
(f1) and (f3). Moreover, suppose that —A + a is positive. Then there exists a minimizer 
of ® on N and, hence, a positive solution of (1.12). 


PROOF. Let (u,) C Ny be a minimizing sequence: ®(u,) > B+. Let us define t, = ||un|l 
and vy = Un /t,. We can assume that v, — v in Hy (2). Since, for every R > 0, 


R2 
S(+/ au dr) -[ F(x, Run) dx = ®(Rvn) < P(un), 
2 2 


we have 


2 
S(+f atxy?ax) = f F(x, Rv) dx < Ba, 
2 Q Q 


so that v # 0. If (¢,) is unbounded, we can assume that ft, — +00. We obtain, from (f3) 
and Fatou’s lemma, the contradiction 


2 
F(x,t 
too= [ imint( A(x) Un a (x, re) ay 
2 


2 ip 
ae ( a(x)v2 i" Fee ay = L 
noo Jo 2 tf 2; 


It follows that (u,;,) is bounded in Hy (2). Going if necessary to a subsequence, we can 
assume that uv, — u in Hy (92). By (fo), since (uy) CNY, 


[ feowar = tim, [Pn un dx 
‘?) n—>oo 2 


= lim (/ a(x)uz dx + Yun) > 0. 
n—>oo Q 


In particular, u 4 0. Since u > 0, there exists t > 0 such that tu €¢ N* and 


P(tu) <liminf O(tup) < liminf (up) = Bx. 
noo n—>oo 


Hence tu is a minimizer of ® on N. 


Theorem 1.23 is due to Liu and Wang [67]. Note that (f3) is weaker than (f2). Efforts in 
weakening (f2) have been made in [46,82] (see also the references therein). 
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1.5. Symmetry of the ground state solution 


In this section we assume that (2 is invariant by rotations: g{2 = 92 for every g € SO(N). 
Theorem 1.17 shows that, even when f is independent of x, the ground state is, in general, 
not radial. However when f = f (|x|, uv), a partial symmetry is always preserved by the 
ground state. 

We arbitrarily choose a fixed direction P in RN which we will refer to as the north pole 
direction. Let R > 0 and do denote the standard measure on 0Br(0). The symmetriza- 
tion A* of a measurable set A C 0 Br(0) is defined as the closed geodesic ball in 0 Br(0) 
centered at the north pole and whose do-measure equals that of A. The foliated Schwarz 
symmetrization B* of a Borel set B C R% is defined on any sphere 0 Br (0) by 


B* N ABR) = (BN ABR(O))* 


and the foliated Schwarz symmetrization of a Borel function wu: RY [0, co[ is defined 
by 


u*(x) =sup{t > 0: x € (ABR(0)N {u > 1})"}. 


See [83] for the Pélya—Szeg6 inequality corresponding to the foliated Schwarz sym- 
metrization. 

The following result is proved in [19] by combining an elementary symmetrization, the 
polarization (see [34]) and the maximum principle. 


THEOREM 1.24. We assume (fo), (£1) and 
(Aj) f:8 x R—- R is Hélder continuous on 2 x [—R, R] for every R > 0, 
(A2) & is radially symmetric, 
(A3) aand f(.,t) are radial functions for every t € R. 
Then every minimizer u of ® on Ny or N— is a foliated Schwarz symmetric solution 


of (1.12). 


A related result can be found in [76], Theorem 3.1. 


1.6. Multiple positive solutions 


Using a more topological argument Benci, Cerami and Passaseo [21,23] were able to estab- 
lish the following result about the impact of the domain topology on the solution structure. 
Consider 


—Autidus=uP!, xen, 
u>0O, xEQ, (1.14) 
u=O, x €d0L, 


on a bounded domain 2 c RY. 
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THEOREM 1.25. Suppose the Lusternik—Schnirelmann category of the domain satisfies 
cat($2) > 2. 
(a) If2 < p <2* then for X sufficiently large (1.14) has at least cat() + 1 solutions. 
(b) If 4 > 0 then for p < 2* sufficiently close to 2* (1.14) has at least cat(2) + 1 
solutions. 


The case p = 2* is of special interest. It is closely related to the Yamabe problem 
from differential geometry. This critical case is analytically more difficult because the 
embedding Hy (22) > Sea (2) is not compact. As discussed in Section 1.1, Brezis and 
Nirenberg [32] obtained one solution for 0 < A <i, if N > 4, and, in the case N = 3, 
showed that there exists A* € [0,A1) so that (1.14) has a solution for A* < 2 < Ay. In 
the case A = 0 and p = 2*, Bahri and Coron [8] obtained one solution if the domain has 
nontrivial homology: Hx (2; Z2) £0 for some k > 1. The existence of multiple positive 
solutions of (1.14) for p = 2* is not known. 


REMARK 1.26. More results about the effect of the topology and geometry of the domains 
on the solutions structure have been given for the singularly perturbed nonlinear elliptic 
equation 


—e*Au+a(x)u=uP!, xEQ, 
u>O0O, xEQ, (1.15) 
u=0, x€02, 


and variations thereof. In fact, Theorem 1.25 can easily be reformulated for (1.15). Typical 
results are concerned with the existence of multiple positive solutions and their limiting 
shape as ¢ — 0. This was first done for the least energy solutions in [75]. Singularly per- 
turbed equations like (1.15) have been a very active area of research during the last fifteen 
years and the number of papers abound. A discussion of this topic goes beyond the scope 
of our survey. 


1.7. The method of moving planes 


This section is related to Section 1.5. We consider the problem 


—Au=f(tu) inQ, 
u>0O in 2, (1.16) 
u=0 on 022, 


where the domain §2 has some symmetry. We shall prove, by the method of moving planes, 
that, under some assumptions, all the solutions of (1.16) inherit the symmetry of £2. 

The method of moving planes was introduced by Alexandrov in 1962 in the context 
of minimal surfaces and was used by Serrin in 1971 and Gidas, Ni and Nirenberg [53] 
in the study of semilinear elliptic equations. The method was extended and simplified by 
Berestycki and Nirenberg [26]. We describe a result of [26], following [29]. 
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We shall need the maximum principle for small domains. Let w be a solution of 


ire in 22, (1.17) 


w>0 ono. 


The standard form of the maximum principle asserts that, if c(x) > 0 in 22 then w(x) > 0 
in §2. In Stampacchia’s form we use a weaker assumption. Let us recall that 


S= inf |Vull5 
ucHd (2) 
Ill y*=1 


is independent of (2. 
LEMMA 1.27. Assume that w € H'(2) Satisfies (1.17) with 
Ilc_llvj2 < S. (1.18) 


Then w > O0in Q. 


PROOF. It suffices to multiply (1.17) by w_, to integrate by parts and to use (1.18). 


Assumption (1.18) is always satisfied if ||c_ |lo. < oo and |{2| is sufficiently small. 
THEOREM 1.28. Let f be locally Lipschitz and let 2 be bounded, convex in some 
direction, say x,, and symmetric with respect to the plane x; =0. Then any solution 
u€C*(R2)NC(2) of (1.16) is symmetric with respect to x; and du/0x\ <0 for x; >0 
in Q. 


PROOF. Let us define 


a=sup{x1: (x1, y)€ 2}, 
2.={1,y)EQix>Al, O<dA<a, 
wa(x) =u(2A— x1, y)—u(x, y), x E924. 


The function wy is well defined on {2, since 92 is convex in the direction x; and symmetric 
with respect to the plane x; = 0. We shall prove that 


w(x) 20 forO<A<a, xEQy. 


In order to see this, we define 


fu1y)—fUQr=x1,y)) if w,(x) £0 


C(x) = wy(X1,y) 
0 if w,(x) =0. 
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The function wy, satisfies 


—Aw,z+c,w,=0 in 2,, 
1.1 
ieee on 092). Ut) 
Moreover, since u is bounded and f is locally Lipschitz, 
sup sup |ca(x)| < OO. (1.20) 


0<A<a xEQ), 
Let us also define 

A={0<A <a: wa 20inQ;}. 
By (1.19), (1.20) and Lemma 1.27, A is not empty. Clearly A is closed in (0, a). Let us 
prove that A is open. Let yz € A and let K be a smooth compact subset of §2,, such that 
|§2, \ K | is sufficiently small for A near jz. From 

Wueec>O ink, 
it follows that 

w, 20 in K ford near p. 
Lemma 1.27 implies that 


w,20 ins2,\K. 


Thus w, > 0 in §2, for A near yz. Hence A is open in (0,a) and A = ]0, a[. It follows 
immediately that, on 92, 


u(—x1, y) Su(xy, y). 


Since u(x, y) = u(—x1, y) is also a solution of (1.16), one finds that u(x1, y) = u(—x}, y). 
It is easy to conclude that du/dx; <0 for x; > 0 using Hopf’s lemma. 


REMARK 1.29. (a) Theorem 1.14 follows directly from Theorem 1.28. It is interesting to 
note that Theorem 1.28 is applicable to domains like cubes. 

(b) The method of moving planes is very flexible and has been adapted to a large variety 
of problems. It is not possible to give a bibliography within this survey. The surveys by 
Berestycki [24] and by Brezis [29] contain many references. 

(c) With respect to Section 1.5 the assumptions on 2 and on f are somewhat stronger, 
but the results are applicable to any positive solution. 
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1.8. A priori bounds for positive solutions 


Topological methods require the existence of a priori bounds for the set of all positive so- 
lutions. In this section we briefly describe particular cases of three classical results. We 
denote by A, the first eigenvalue of —A on He (§2) and by e; > 0 the corresponding eigen- 
function. Throughout this section we assume that 2 is a smooth bounded domain in R” 
and that f : 2 x R+ > Rt? is continuous. 

The first result is due to Brezis and Turner [33]. The proof uses Hardy’s inequality. 


THEOREM 1.30. Assume that 


lim inf few) >, uniformly for x € @. 
u—>0o u 
and 
, = N+1 
lim Fw) =0 uniformly for x € 2, wherea= Semis, 
u>oo uu N-1 


Then there exists c > 0 such that if u € Hy (2) satisfies 


—Au= f(x,u)+te, in, 
u>0O in 82, 
u=0 on 082, 


for some t > 0, we have ||U|loo <c. 


The second result is due to de Figueiredo, Lions and Nussbaum [51]. The proof uses the 
Pohozaev identity. 


THEOREM 1.31. Assume that Q is convex, f :R* > R°* is locally Lipschitz and 


lim sup fw) >A, and lim J(u) =0, where a = ——. 
eso u>oo 4% N-2 


Then there exists c > 0 such that, if u satisfies 


—Au=f(u) in, 
u>0O in 82, 
u=0 on 082, 


we have ||u||L~° <c. 


The third result is due to Gidas and Spruck [54]. The proof uses a blow-up argument and 
Liouville theorems for the space R™ or the half-space RY : 


22, T. Bartsch et al. 


THEOREM 1.32. Assume that there exists a continuous function h: Q — (0, 00) such that 


f(Q,u) N+2 
u& 


=h(x) uniformly for x € 2: where 1 <a < No’ 


lim 
u—>oo 


Then there exists c > 0 such that, if u € C?2(2)NC(R) satisfies 


—Au=f(x,u) ing, 
u>0O in 82, 
u=0 on 082, 


we have ||Ulloo Kc. 


2. Nodal solutions on bounded domains 


In this section we report on recent results concerning nodal solutions of 
eee x EQ, (2.1) 


u=0 ono. 


Here @ is a bounded smooth domain in RY, N > 2, though some general results apply to 
unbounded domains. In the first two subsections we present two ideas how to localize crit- 
ical points of the associated functional outside of the set of positive or negative functions. 
In the third subsection we give a nonlinear version of Courant’s nodal domain theorem for 
eigenfunctions of the Laplace operator. This gives an upper bound on the number of nodal 
domains of a solutions of (2.1) related to the min—max description of the critical value. In 
the Sections 2.4 and 2.5 we prove the existence and some properties of least energy nodal 
solutions. Finally, in Section 2.6 we study the existence of multiple nodal solutions. 


2.1. A natural constraint 


In this subsection §2 may be unbounded. We consider the problem (2.1) with f satisfying 
(fo) and (f;) from Section 1.3. Recall the functional ®: E = Hy (92) — R and the Nehari 
manifold 


N = {u € E \ {0}: &’(u)u =0} 


from Section 1.3. In Theorem 1.21 we showed that a minimizer of © on NT = {u € 
N: u > 0} is a positive solution of (2.1). In order to obtain nodal solutions, we consider 
the nodal Nehari set 


S={ueE: ut EN, u_eN} 
={ueE: ut A04u_,P'(u)ut =0=98'(u)u}. 
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Clearly, S C N contains the set of all nodal solutions. 


THEOREM 2.1. Suppose (fo) and (£1) hold. Then B := inf &(S) > 0, and every minimizer 
of ® on S is a nodal solution of (2.1). 


In Section 2.4 we shall prove the existence of a minimizer of ® on S. Since the maps 
E— E,ut u= are continuous but not differentiable, S is not a differentiable manifold 
even if \V is one (as in Proposition 1.19). 


PROOF OF THEOREM 2.1. Clearly 6 = inf ®(S) > inf ®WW) > 0 by Theorem 1.21. Let 
u € S be a minimizer and suppose &’(u) 4 0. As a consequence of (f;), for any v EN, 
the function Ry 53 tt» @(tv) € R achieves its unique maximum at ¢ = 1. Therefore 


(su + tu) = @(su*) + D(tu')< ®(u*) + @O(u_)= P(u) (2.2) 


for (s,t) € Ry \{C, 1}. By the continuity of ®’ there exist a, 6 > 0 such that || @’(v)|| > a 
for v € U35(u). Setting 


1 3 1 3 
eD=( )x( ) > E, g(s,t)=sut +tu, 
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(2.2) implies Bp := max® o g(dD) < B. For ¢:= min{ 2-0 , a3} and S = U3(u), 
Lemma 1.22 yields a deformation 7 such that n; := 7(1,-): E > E satisfies: 

e m(v) =vif O(v) < B —2e, 

oe (Bot? S) c OF-*, 

e P(N (v)) < O(v) forall ve E. 
It follows that max ® o nj o g(D) < f and that h := n| o g = g on OD. We shall show that 
h(D) 1S 49, which gives the contradiction inf |.5 < 6. Consider the map 


w:D> R?, Wis, t):= (<o' ne, t)*)h(s, tt, (hs, t) )h(s, »~) 
Ss 
and observe that w(s, t) = (0, 0) is equivalent to h(s, t) € S. For (s, t) € 0D we have 
wis, t)= (O'(sut)ur, ®'(tu- )u) 


because h = g on 0D. This implies deg(y, D, (0, 0)) = 1, hence w(s, t) = (0, 0) for some 
(s,t) ED. 


REMARK 2.2. (a) The proof of Theorem 2.1 is a two-dimensional version of the proof of 
Theorem 1.21. A minimizer of ® on N* or N7~ is a local minimum of ® on NV, hence 
a critical point of mountain pass type. Though not being a manifold, S is a kind of co- 
dimension | subset of NV’, a co-dimension 2 subset of E. Hence a minimizer of ® on S is 
a critical point of Morse index 2 (if nondegenerate). 
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(b) In [17], Lemma 3.2, Bartsch and Weth prove that SO H?(Q) is a co-dimension 2 
submanifold of EM H?(Q2) if f satisfies the conditions (f) and (f}). 

(c) In [67] Liu and Wang give a slightly different proof of the above result without using 
the deformation lemma and therefore requiring less smoothness of the functional. 


2.2. Localizing critical points 


A basic idea for localizing critical points can be formulated in a very general setting. Let 
X be a topological space and g:G C [0,0o) x X > X be acontinuous semiflow on X. 
Here G = {(t,u) € [0, 00) x X: 0 <t < T(u)} is an open subset of [0, 00) x X, where 
T (u) € (0, oo] is the maximal existence time of the trajectory th g(t, uv). We often write 
g' (u) = g(t, u). 

Given BC AC X we call B positively invariant in A if, for u € B and T > 0 with 
g'(u)€ A, 0<t<T, it follows that gy (u) € B. If even y! (uv) € int B then B is said to 
be strictly positively invariant. In the case A = X, we simply call B (strictly) positively 
invariant. The notion of invariant sets has also been exploited in [65]. 

Recall that a continuous map y : (C, D) — (A, B) between pairs D C C, B C A of topo- 
logical spaces is nullhomotopic if there exists a homotopy H:(C x [0,1], D x [0, 1]) > 
(A, B) with H(x,0) = y(x) and A(x, 1) € B forall x eC. 


LEMMA 2.3. Let A C X be positively invariant, B C A Strictly positively invariant. Let 
f:(C, D) > (A, B) be not nullhomotopic, C a metric (paracompact) space. Then 


A(B) := {x €C | ar >0: g' (f(a) € BJ AC. 


PROOF. We argue by contradiction. If A(B) = C then for each x € C there exists t(x) >0 
with g™) (f (x)) € int, B. Choose a neighborhood V, of x in C with 


g™™ (f(y) e€intyB forall ye Vx. 


Let (j)jey be a partition of unity subordinated to V,: supp; C V;,;. Now we de- 
fine o0:C — [0,00), o(x) := Dies MI@TA,), and H:C x I> A, A(x, f) := 
g'° (f (x)). This homotopy shows that f is nullhomotopic. 


There also exists an equivariant version of Lemma 2.3 when a group G acts on A and C. 
The extension is straightforward and therefore omitted. 

In a typical application, g is the negative gradient flow of a functional ®: X — R, and 
B contains a sublevel set 6? = {u € X: J(u) < b}. A and B are closed and one wants to 
find a critical point in A \ B. For x € C \ A(B) and u := f(x), one then has 


g'(u)¢B, hence &(g'(u)) > b for all t. 


Then c := lim;s 90 ®(y' (u)) > b and there exists a sequence ty — 00 with 


d 
|ve(rw)|=Ts('w)| 0. 


t=th 
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Thus uy := vy (u), n EN, is a (PS)--sequence in A \ B. If u, > u then u ¢ B because 
otherwise u = y' (uv) € int, B, hence (wu) € int, B for some t,, a contradiction. Thus 
ne A\B. 

We shall now present examples of strictly positively invariant sets which can be used 
to find nodal solutions of (2.1). Thus we are interested in finding critical points of the 
associated functional ® outside of 


P©={uekE: tu>Oae.}. (2.3) 


Since P* and P~ have empty interior one cannot use B= P* U P-. 
EXAMPLE 2.4. Suppose & is bounded, and (fj) and 

(f4) there exists m > 0 so thattr f (x,t) + mt is strictly increasing for all x € 2 
hold. We take 


(u, UV) m = (Vu, Vv) 72 ar mu, Vv) 72 


as scalar product in E and write ||- || for the corresponding norm. Setting g(x, u) = 
f(x, u)+mu and G(x, t) = fo g(x,s)ds we can write ® as 


1 
Pu) = 5 lull -f[ G(x, u) dx. 
Q 
Thus the gradient of ® with respect to the above scalar product has the form 


V@=Id—K with K(u)=(—A+m)_!(g(-,u)). 


By (f}), K leaves X = C!(2) N E invariant. The cones Py := X 1 P* have non- 
empty interior in X because {2 is bounded. We write u < v if v-—ue Py ,andu<uv 
ifu—ue int(Py ). As a consequence of the strong maximum principle, K is strictly order 
preserving, that is, 


u<v = K(u)<«K(v) foru,vex. 


We consider the differential equation 


d 
ay? =-V9(y'(u)) =—¢'(u) + K(¢'w)) 


which induces a flow on X (and £). Since K is strictly order preserving the set Py \ {0} 
is strictly positively invariant. More generally, if wu € X is a subsolution, that is, u < K(u), 
then u + (Py \ {0}) is strictly positively invariant. This follows from the fact that for v > 0 
the vector field —V® points at u + v into u +int PY, 


utv—V@®u+v)=Ktu+v)> Ku). 
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Similarly, if u is a supersolution then u + (Py \ {0}) is strictly positively invariant. In order 
to find nodal solutions above some level a > 0 one can work with B := 6% U Pe U Py 
which is strictly positively invariant for if there are no nodal solutions at the level a. 


EXAMPLE 2.5. Suppose Q is bounded, and (fj) and 

(fs) inf,zo f (x, 1)/t > —00 
hold. Then we choose m > 0 so that f(x, t) + mt > 0 for allt >0, f(x, t) + mt <0 for 
all t < 0, and define (-, +), X and the order relation < as in Example 2.4. The gradient 
of ® with respect to this metric is not necessarily order preserving but it does satisfy 


u>O = K(tu)>0 and u<0 = KW) <0. 


It follows as in Example 2.4 that the cones Py \ {0} are strictly positively invariant. 


If 2 is unbounded or if f is only a Carathéodory function, the approach presented in 
Example 2.4 does not work because then one cannot work in X =C '(Q) 1 E. Either the 
cones Py have empty interior or there is no flow on X due to a lack of regularity. Here one 
can often replace P~ by their open neighborhoods in E. 


DEFINITION 2.6. Let K: E — E be a continuous operator on a Banach space E. A set 
C C E is said to be K attractive if there exists ¢97 > 0 so that K (clos(U,(C))) C U,(C) = 
{u € E: dist(u, C) < e} for0 <e€ < & . 


LEMMA 2.7. Let E be a Banach space, ® € C!(E) andC =C,U---UC, C E be a finite 
union of convex sets. Suppose V® = Id—K, and each C; is K-attractive. Then ® has no 
critical points in clos(Ug,(C)) \ C, where €9 is from Definition 2.6. Given € € (0, €0] there 
exists a pseudo-gradient vector field V: E \ Fix(K) —> E for ® so that clos(U,(C)) is 
strictly positively invariant for the flow associated to —V. 


PROOF. For € € (0, &9] and u € dU,(C;), we have K (u) € U,(C;). Since C),..., Cy are 
convex, a standard partition of unity argument yields a locally Lipschitz continuous map 
K \ Fix(K) —> E such that 


K(u)€U,(Cj) forw€dU-(Cj), j=1,....0, 
and 


|u- Kw] <2) 9'w f 


! ~ 1 / 
, B(u)(u— Kw) > 5") 


for u € E \ Fix(K). 


Here are two examples of K -attractive sets. 


EXAMPLE 2.8. Suppose f satisfies (fo) and (f5). Thus there exists m > 0 as in Exam- 
ple 2.5, and we define K(u) = (-A+ m)'(f¢, u) + mu). If limsup,_,9 | f(x, t)|/|t| < 
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Ai(S2) uniformly in {2 then it has been proved in [12], Lemma 3.1, that P~ = {u € 
E: tu >0a.e.} is K-attractive. We sketch the argument in a more complicated parameter 
dependent situation (see Lemma 3.17). 


EXAMPLE 2.9. Suppose f satisfies (fp) and (f4). Set E = Hy (2) and K(u) = (-A+ 
m)—! (f(-,u) + mu) as in Example 2.4. In [44] it is proved for bounded {2 that, for a strict 
subsolution u € EN Ww, the cone u + P* is K-attractive. 


EXAMPLE 2.10. When £2 is unbounded, neighborhoods of shifted positive and negative 
cones in the directions of the first eigenfunctions have been proved to be K-attractive 
in [66]. The situation is more delicate here and some conditions on the spectrum of the 
linear operator have be to assumed. 


The Examples 2.4, 2.5 and 2.8 together with Lemma 2.7 yield strictly positively invariant 
sets which can be used to find nodal solutions of (2.1) or (2.2) with the help of Lemma 2.3. 
We shall do this in Sections 2.4 and 2.6. 


2.3. Upper bounds on the number of nodal domains 


In this subsection @ C R% may be unbounded. A nodal domain of a continuous function 
u:§2 — Risaconnected component of 92 \ u—!(0). We write nod(w) € No U {00} for the 
number of nodal domains of u and set nod(u) = 0 for u = 0. 


LEMMA 2.11. Suppose f satisfies (fo). Then every weak solution u € E of (2.1) is con- 
tinuous. If 29 C 82 is a nodal domain of u then u- XQ. € Hy (22). 


PROOF. First observe that f(-,u)/u € L\Y/?(Q) by (fo) and the Sobolev embedding the- 
! (9) for every 2 <q < oo and there- 


orem. The Brezis—Kato theorem [30] implies u € Ly, 
fore f(-,u) € Li,,() for s > N/2. Then u is continuous by elliptic regularity. The last 
statement has been proved in [73], Lemma 1. 


Now we suppose that (f) and (f,) hold. Let VV be the Nehari manifold and S CN the 
nodal Nehari set. 


PROPOSITION 2.12. Suppose (fo) and (f1) hold. Let u be a critical point of ® and fix 
neéeN. 
(a) If ®(u) <inf ®(S) +n- inf BWW) then nod(u) <n +1. 
(b) If ®(u) < infy,,...», sup P(C(,..., Un)) then nod(u) <n. The infimum ex- 
tends over all n-tuples of linearly independent elements v,,...,Un € E, and 
C Wis ta) a ae PE Ate An SO, 
(c) If f is odd and ®(u) < infycEdim(v)=n Sup P(V) then nod(u) <n. Here the infi- 
mum extends over all n-dimensional linear subspaces of E. 
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PROOF. (a) Let u have k nodal domains 92),..., 2% such that vj :=u- xQ, > O and 
v2 = U- XQ, < 0. Clearly, vj :=u- Xa; € N and v1 + v2 € S. Theorem 1.21 implies that 
v; 1s not a minimizer of @ on N, hence 


k 
O(u) = (vy, + v2) + > ov;) > inf 6(S) + (k — 2) inf BW). 
J=3 


This implies k <n+1. 
(b) and (c) Suppose nod(u) > n and let 92),..., 2, be nodal domains of u. Then 
Uj =U XQ, € N and @(v;) = max, >0 ® (Av; ). This implies 


P(u) > O(vyit+---+vp) > inf sup ®(C(v1,..., Un). 
Un 


Utades 


If f is odd then @(v;) = max,cr ®(Av;), hence 


P(u) > O(vy +--+ + Un) = inf sup ®(V). 


If ® € C*(E) then the Morse index provides a lower bound for the number of nodal 
domains. 


THEOREM 2.13. Suppose (f)) and (f;) hold and let u be a critical point of ® with Morse 
index (u). Then nod(u) < (u). 


PROOF. Let £21,..., 62, be nodal domains of u and set vj :=u - x2; € N. Then 


@"wlvj.vj1= f IvuPax— f fila, uv; dx 
Q , Q , 


<| IvuPax— f f(x, vj)vj dx 
2 , 2 
=0 


and therefore, (u) >n. 


The results of this section should be compared with Courant’s nodal domain theorem for 
eigenfunctions of the Laplacian. 
2.4. The existence of nodal solutions 
In this subsection 2 C RN" is required to be bounded. 


THEOREM 2.14. Suppose (f}) with p < 2* and (f2) hold. If the second Dirichlet eigen- 
value X42(—A + a(x)) > 0, then (2.1) has a nodal solution. 
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PROOF. We first observe that (f4) and (f2) imply (fs), so there exists m > 0 with 
f(x, t)t + mt? > 0 for t 40, x € @. Proceeding as in Example 2.5 we consider the scalar 
product (uv, V)m:= (Vu, Vv) 7,2 + mu, v);2 on E= ih (2) and let y' be the correspond- 
ing negative gradient flow of the energy functional associated to (2.1). 

Let e; > 0, e2 be linearly independent elements of X = ENC '(Q). By (f2), there exist 
R>0so that ®(u) < 0 for u € span{e), e2}, ||u|| => R. We define 


C:= {u=se + te: SE [—R, R],te€ [O, R}} 


and D := 0C C span{ej, e2}. Let E; C E be the first eigenspace of —A + a(x). Since 
A2(—A + a(x)) > 0, there exist a, 9 > O so that 


P(u) >a forue E}, |\u|| =p. 


Setting S:= {ue Ei : |lu|| = e} the inclusion (C, D) @ (E, E \ S) is well defined and 
not nullhomotopic. We fix 6 € (0, ~) so that (2.1) has no nodal solutions on the level £. If 
no such 6 exists the theorem is proved anyway. 

As stated in Example 2.4, the flow yg’ leaves X invariant and B := (XN @8)U Py U Py 
strictly positively invariant. By construction we have B M S = ¥% which implies that the 
inclusion (C, D) — (X, B) is not nullhomotopic. Now Lemma 2.3 yields u € C so 
that g'(u) ¢ B for every t > 0. It follows that there exists a sequence t, — oo with 
IVE" win = |G PY" (w))| > O.as n> ov. 

Thus u, := g™(u), n € N, is a (PS)--sequence for some c > B, hence uy, > a in E 
along a subsequence. By the w-limit lemma from [10] u, — u in X. This implies u ¢ B 
because u is a critical point of ®, u, ¢ B, and B is strictly positively invariant. Thus u is a 
nodal solution of (2.1). 


THEOREM 2.15. Suppose (f}) with p < 2* and (f2) hold. If 0 ¢ o(—A + a(x)) then 
(2.1) has a nodal solution. 


This theorem is a simple consequence of basic Morse theory which we recall here. 


THEOREM 2.16. Let X be a Banach space, ® € cC!(X,R), and g' a (local) flow on X 
with the properties: 

(GRAD) If @’(u) £0 then t + ®(y' (u)) is strictly decreasing. 

(COMP) If (g'(u)) > c€ Rast > ov then {g' (u): t > 0} is relatively compact. 
Let H,, be any homology theory and let Cy(®, u) := Hy(®*, BS \ {u}), c = Bu), be the 
kth critical group of ® at u. Finally, let B C X be strictly positively invariant such that 
® has only finitely many critical points uy,...,ux € X \ B. Setting Py := rank Hy (X, B) 
and Px(uj) := rank Cx (®, u;), there exists Q € No[[t]] such that 


363 an => tk +t Qo. 


k=0 Ajai k=0 


30 T. Bartsch et al. 
The proof is a variation of standard arguments, cf. [41], Theorem 1.4.3. 


PROOF OF THEOREM 2.15. We consider ©, y' and X as in the proof of Theorem 2.14 
and recall that the conditions (GRAD) and (COMP) hold. By Theorem 2.14, we may 
assume A;(—A + a(x)) < 0. Then we; > 0 is a Strict supersolution of (2.1) for a > 0 
small. Here e; > 0 is a first Dirichlet eigenfunction of —A + a(x). By Example 2.4, 
A:= (ae, + Re ) U(-ae, + Py) is strictly positively invariant. Condition (f2) implies 
that Hy(X, ®~*) = {0} for B > O large (see [41], Lemma III.2.3), any k € Z. (f2) also im- 
plies (tu) > —oo as t > oo for u £0. It is now easy to show that B:= AU ®~ can be 
deformed into 6~F by a deformation of the form (t,u)b tu forue B,O<t<T(u). As 
aconsequence H;,(X, B) = {0}, k € Z. Since B is strictly positively invariant, we can apply 
Theorem 2.16. By assumption, 0 € X \ B is nondegenerate, hence C,,(®, 0) 4 {0}, where 
jt is the Morse index of 0. It follows that there exists a critical point u € X \ B, u £0, with 
Curi(®, u) A {O} or Cy-1(®, u) F {O}. Clearly u is a nodal solution of (2.1). 


Next we assume (f}), that is, f-> f(x, 1)/|t| is strictly increasing on Rt and on R-. 
Recall the nodal Nehari set 


——— 


S= {« EE: uF 0. f VuVu- =f f(x, uwu> 
2 2 
from Section 2.1. 


THEOREM 2.17. Suppose (f)) with p < 2%, (f}) and (f2) hold. If 42(—A +.a(x)) > 0 then 
inf (S) > 0 and it is achieved by a nodal solution with precisely two nodal domains and 
Morse index 2. 


A minimizer of ®|5 is a least energy nodal solution. Geometric properties of these on 
radial domains will be investigated in Section 2.5. 


PROOF OF THEOREM 2.17. Consider a minimizing sequence e, € S,n € N, of ®|s, and 
define 


C= {u =set +te,: s€[—Rn, Ral, t €[0, Rl}, 


where R,, > 0 is chosen so that ®(u) < 0 for u € span{er, €; }» lull = Rn. Observe that 
P(e,) = max @(C,,) as in (2.2). Now, the same argument as in the proof of Theorem 2.14 
yields a nodal solution u, € S with ®(u,) < O(e,). Moreover, (uy) is bounded away 
from 0. In fact, ®(u,) > inf P({u € Be ||u|| = e}) > 0, where E} is the first eigenspace 
of —A+ a(x) and p > 0is small. Thus (u,), is a minimizing sequence of ®|s consisting 
of critical points. Thus inf ®|s5 is achieved by the Palais—Smale condition and because S is 
closed in E. The equality nod(u) = 2 for a minimizer u follows from Proposition 2.12. 
By Remark 2.2(b), SM H?(Q) is a submanifold of EM H?(92) with co-dimension 2. 
The Hessian 6” (iz) of ® at a minimizer u of ®|¢g is therefore positive semidefinite on 
the tangent space V := 7;(S MN H?(Q)) C EN H*(Q) which has co-dimension 2 in 
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EO H?(Q). It follows that &”(u) is positive semidefinite on V& C E which has co- 
dimension 2 in E. 


REMARK 2.18. (a) The first existence results for one nodal solution under similar hy- 
potheses as those considered here are due to [15,36,50]. Improved versions and related 
results can be found in [17,37,45]. In [90] of Wang, besides the positive and negative solu- 
tions given in [5] by Ambrosetti and Rabinowitz a third solution was found by two different 
methods: linking and the Morse theory. No nodal information was given for the third so- 
lution in [90], but the methods used there seem to be suggestive for the nodal nature of 
the solution, motivating some of the results mentioned above. Using symmetries of the 
domain, the existence of nodal solutions can be proved more easily. Results of this type 
abound, in particular, for radially symmetric domains. 

(b) In the recent paper [67] of Liu and Wang, it is proved that inf (S) > 0 is achieved 
by a nodal solution with precisely two nodal domains provided (fg), (f;) and the condi- 
tion (f3), that is, limys)}+99 F(x, t)/t? = oo uniformly in x € 2, hold. Observe that this 
condition is weaker than the classical Ambrosetti-Rabinowitz condition (f2). Under the 
same conditions a positive and a negative solutions are given as in Theorem 1.23. The 
proofs is in the same spirit of that for Theorem 1.23. 


2.5. Geometric properties of least energy nodal solutions on radial domains 


We consider 


Loereleed\s) in Q, (2.4) 


u=0 on 092, 


when {2 is a ball or an annulus and a and ff are radial. It is then natural to ask about the 
symmetry of solutions of (2.4). We shall address this question for the least energy nodal 
solution when it exists. 


THEOREM 2.19. Suppose 92 is a ball or an annulus, a € L® (82) and f are radial, and 
f satisfies (fo) and (f,). Suppose, moreover, that f is Hoélder continuous on Q x [—R, R] 
for every R > 0. Then every least energy nodal solution is foliated Schwarz symmetric. 


This result is due to [19]. Its proof is based on an elementary symmetrization, the polar- 
ization, and the maximum principle as the one of Theorem 1.24. 

If f = f(u) is independent of x the problem whether a least energy nodal solution is 
radial has been settled recently by Aftalion and Pacella [1]. The remaining part of this 
section contains several results from [1]. We begin with the following observation relating 
the number of nodal domains to the Morse index. 


THEOREM 2.20. Suppose S2 is a ball or an annulus, and f € cl(R) satisfies f (0) > 0. 
Let u be a radial solution of 


| —Au=f(u) in, 
u=0 on 082. 
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Then the Morse index of u is at least (N + 1)(nod(u) — 1). 


PROOF. Let @ = A(r, R) = intlx ERY: r< |x| < R} and let r=rp9 <r) <-:: < 
rk-1 <r, = R be such that A; = A(r;_1,7;), i= 1,...,k = nod(u), are the nodal do- 
mains of uw. We consider the domains B; = A(7j-1,7ri+1) and Bjj = {x € Bj: xj; < O}, 
i=l,...,k—1, j=1,..., N. Let yj; be the first Dirichlet eigenvalue of —A — f'() in 
B;j and wi; >0, a corr sueuame eigenfunction. We claim that j1;; < 0. If this has been 
proved let uj; € Hy (Bi) Cc Hy ($2) be the extension of yj; which is odd in x;. Then v;; is 
a Dirichlet eisentinetion of —A — f’(u) in B; with ree naue Mid j <0. Since v;; changes 
sign, there exists a positive eigenfunction vjo € Hy (Bi) Cc Hy (2) of —A — f’(u) with 
eigenvalue j1j9 < ij; < 0. It follows that the adadrlic form vF> ((—A — f'(u))u, v) 72 is 
negative on span{vjj; i=1,...,k —1, j =0,..., N}. Since the vjj,i=1,...,k -1, j= 
0,..., N, are linearly independent by construction, the negative eigenspace of —A — f’(u) 
in Hy (2) has dimension at least (k — 1)(N + 1) = (nod(u) — 1)(N +1). 

It remains to prove j1;; < 0. Observe that uj; := du/dx; solves —Au; = f’(u)u; in es 
Let 0B; = {x ER’: |x| = 1rj+1} be the outer boundary of B;. Since u is radial, u ;(x) = 
if x; = 0. Suppose u > 0 on A(7j, 741) C Bj; and u <0 on A(7j{_-1,7;) C B;. a 
uj(x) > 0 for x € 0B; with x; <0, and Cj; := {x C Bij: uj (x) < 0} € Bj; is a nonempty 
open subset of Bj; with 0C;; C Bij U {x: xj =O}. 

It follows that u; =0 on 0C;;, hence u; € Hy (Cij) C Hy (Bij). Therefore 


(-A — f'@))v, V) 12(B;, 


ij) 


Mij — inf 
“ved (Bis) vl 2(B;,) 
(A= f'@))ujuj)2cy) — ' 
le jIlz2c,) , 


COROLLARY 2.21. Suppose 9 is a ball or an annulus, and f :R — R is independent of 
x € 92 and satisfies (f4) and (7) Then a least energy nodal solution of (2.1) is not radial. 


PROOF. The proof of Theorem 2.17 shows that a minimizer of on S has Morse index 2. 
Now the result follows from Theorem 2.20. 


THEOREM 2.22. Suppose Q is a ball, and f = fu) satisfies (f)) and (f;). Let u be a 
least energy nodal solution of (2.1). Then the nodal set clos (u-!(0) N @) intersects OQ. 


PROOF. Arguing by contradiction we suppose u has constant sign near 0{2. By Theo- 
rem 2.19, we may assume that uw is axially symmetric around the axis {0} x RC R%. In 
particular, u is even in x1,...,x\y—1. Now, as in the proof of Theorem 2.20, one sees that 
the Morse index of u is at least N. Thus we are done if N > 3 because the Morse index 
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of u is 2. In the case N = 2, one can use the angle derivative du/06 and the fact that u is 
foliated Schwarz symmetric but not radial. Details can be found in [1]. 


REMARK 2.23. It is tempting to conjecture that in the situation of Theorem 2.22 and its 
proof, the least energy nodal solution uw, being even in x1,...,Xy—1, is odd in xy and that 
its nodal surface is the set {x € 2: xy = 0}. For the singularly perturbed problem 


| —e*Aut+u=|ulPu in Q, 
u=0 on 022, 


this has been proved by Wei and Winter [94] if ¢ is small. 


2.6. Multiple nodal solutions on a bounded domain 


On an interval 2 = (a, b) C R, the problem, 
eNee ae fora<x <b, (2.5) 
u(a) = u(b) = 0, 


has infinitely many nodal solutions if f is superlinear in the sense of (f2). A rather general 
result in this direction is due to Struwe [87]. It is an open problem whether (2.1) has 
infinitely many solutions assuming (fo) with p < 2* and (f). The existence of multiple 
(nodal) solutions has been proved under additional conditions on the domain or on f. We 
present several such results in this and the next subsection. 


THEOREM 2.24. Suppose f satisfies (f,) with p <2*, (f;) and (fz). If in addition f is 
odd in u then there exists a sequence ux, k > kg, of nodal solutions of (2.1) with the 
properties: 

(a) ||uklle > 00 as k > 00; 

(b) 2 <nod(ug) <k; 

(c) ifu < ux is a subsolution of (2.1) then u <0; 

(d) ifu > ux is a supersolution of (2.1) then u > 0. 


Here kg = u(—A + a(x)) + dimker(—A + a(x)) + 1, where w(—A + a(x)) denotes the 
Morse index. The existence of infinitely many solutions as well as property (a) is a classical 
result of Ambrosetti and Rabinowitz [5] based on the symmetric mountain pass theorem. 
The fact that the solutions are nodal and properties (b)-(d) has been proved in [10,17] 
where co-homological linking properties are being used; see also [61], where the existence 
of nodal solutions is proved using the Lusternik-Schnirelmann theory. It is not known 
whether nod(uz) — oo as k — oo. In fact, it is not even known whether nod(u;) > 3 for 
some k. In the following, we sketch the proof from [61] for the existence of infinitely many 
nodal solutions using a variant of the symmetric mountain pass theorem. 
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PROOF OF THEOREM 2.24. Set Aj = Aj(—A + a(x)), Ej; = ker(—A + a(x) — Aj), 
Y= a, E; and Z; = @Pe, Ej. Then it is easy to check that, for all k with Ax > 0, there 
are pz > re > 0 such that SUP YA Bp, (0) @P(u) < ay :=O0 and by := infz,n9B,, (0) @(u) > 0 
and by > oo. Let X = C!(2)M E. Then Y¥; C X for any k > 1. Let Py be as in Exam- 
ple 2.4. Then Py are invariant sets of the negative gradient flow. Moreover, for k > 2, 
Zi. Py = {0}. This can be seen by noting that, for all u ¢ P* \ {O}, ie ug, dx 40 while 
for u € Zz, i 241 dx = 0, where ¢ is the first eigenfunction of the Laplacian opera- 
tor on £2. As a consequence of the Borsuk—Ulam theorem, the inclusion (Bz, 0Bg) > 
(E, @°UPtU P~) is not nullhomotopic; here By = {u € Yx: |u|] < ox}. Lemma 2.3 or 
the deformation lemma from [61] or the proof of [61], Theorem 3.2, yield a critical point 
outside of P+ U P~. In fact, it follows that 


ck i= inf sup D(u) > by 
nET veh(By)\(PEUPx) 


is a critical value with a critical point in E \ (P+ U P~); here Ty = {h € C(By, X): his 
odd, and h(u) = u if ||u|| = px}. 


The idea in the above proof can be adapted for many other boundary value problems with 
different nonlinearity; see [61] for more examples. See also [92] for an abstract version 
of a variational principle in the presence of invariant sets of the flows. Nodal solutions 
for nonlinear eigenvalue problems with superlinear nonlinearity have been studied in [47, 
61,63]. 

Without symmetry of the domain or the nonlinearity it is not known whether the super- 
linear problems considered here have “many”’, even infinitely many solutions. Now we dis- 
cuss the role of the domain. If §2 is aradial domain and f = f (|x|, u) is radially symmetric 
in x then one can look for radially symmetric solutions u(x) = v(|x|). Rewriting (2.1) as an 
ordinary differential equation for u(r), ODE methods can be applied. In this setting there 
exist solutions with any prescribed number of nodal domains for a large class of superlinear 
nonlinearities. 

The following recent result gives a lower bound on the number of solutions when the 
domain is large in the sense that it contains balls of large sizes. 


THEOREM 2.25. Suppose f = f(u) is independent of x € @ and satisfies (£}) with 
p<2*, (f}), (f2), and f’(0) <0. Then there exists R > 0 such that if 2 contains a ball of 
radius R then (2.1) has at least 3 nodal solutions uy, u2, u3 with nod(u,) = nod(u2) = 2, 
2 <nod(u3) <3. 


The proof can be found in [18]. This result is in some sense of the singularly perturbed 
type; cf. Remark 1.26. It yields 3 nodal solutions of the singularly perturbed problem (1.15) 
on any domain. As mentioned in Remark 1.26 there is a huge literature about singularly 
perturbed problems, which we cannot present in this chapter. 
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2.7. Perturbed symmetric functionals 


It is natural to ask whether the solutions continue to exist if an odd function is perturbed, 
e.g., f(x, u) = |u|?~2u + g(x). This subsection is devoted to semilinear elliptic problems 
of the type 


an = |y|P-2 i 
| Au=|ulP-*u+h(x) ing, (2.6) 


u=0 on 082, 


where 2 C R% is a smooth and bounded domain, 2 < p<2* andhe L?(Q) is fixed. 
Solutions of (2.6) are critical points of 


1 1 
@(u)== | |Vul?dx——] |ulPdx— | hudx, ue Hy(2). 
2JQ PJ2Q Q : 


When h = 0 and p < 2* the corresponding functional 
1 2 1 1 
Pou) == | |Vulodx—— | |ulPdx, ue Hy(2), 
2 Ja P 


is odd and has infinitely many critical points. The following result is due to Bahri 
and Lions [9] improving earlier work of Bahri and Berestycki [7] and, independently, 
Struwe [86]. 


THEOREM 2.26. If2 < p < (2N — 2)/(N — 2) then, for every he L?(Q), problem (2.6) 
has infinitely many solutions. 


The proof is based on the idea that @ is a kind of perturbation of ®p. The symmetric 
linking which is based on the Borsuk—Ulam theorem and used in the proof of Theorem 2.24 
applies to ®o and yields a nonsymmetric linking for ®. A different approach to perturbed 
symmetric functions is due to Bolle; see [27,28]. It is still not known whether (2.6) has 
infinitely many solutions for any 2 < p < 2* and any h. However, Bahri proved in [6] the 
following generic existence result for the full range of p. 


THEOREM 2.27. If 2 < p < 2* then the set of h € H~'(Q) such that problem (2.6) has 
infinitely many solutions is a dense residual set in H~'(Q). 

3. Problems on the entire space 

In this section we consider the problem 


nee xeR”, (3.1) 


u(x) > 0 as |x| > 00. 
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Depending upon the potential function V(x) we review the existence of signed solutions, 
nodal solutions and multiplicity of solutions as well as their qualitative properties in some 
cases. Let 


1 
®:E>R, ow=; | IVul? + V(ePax — f F(x, u) dx 
2 JRN RY 


be the functional associated to (3.1). As usual, F(x, t) = i Ff (x, s) ds. The nonlinearity f 
will always satisfy (fo) and is subcritical, so that ® is defined on the space 


E= {« E H'(RY): [ V(x)u? dx <00| 
RYN 


and is of class C!. If V is bounded then E = H!(R") and the Palais-Smale condition 
does not hold. On the contrary, if V(x) — oo as |x| > o© then @ does satisfy the Palais— 
Smale condition. This compact case is most closely related to the bounded domain case 
in terms of the results and methods and will be dealt with in Section 3.1. If V and f are 
radially symmetric it is natural to look for radially symmetric solutions. Constraining E to 
the space Eyaq of radial functions u = u(|x|) compactness is recovered. We deal with the 
symmetric case in Section 3.2. In fact, in both Sections 3.1 and 3.2 weaker conditions than 
those just mentioned will be considered. 

In the remaining subsections we deal with bounded, nonradial potentials, in particu- 
lar with potentials which are periodic in the x;-variables. Since f is subcritical this case 
may be called locally compact, a notion going back to Lions’ seminal work [64]. Locally 
the problems have compactness, and the compactness is only lost from the mass going to 
infinity. Lions’ concentration—compactness principle is an important tool in dealing with 
this and will be used. In Section 3.3 we consider potentials having a potential well whose 
steepness is controlled by a parameter. In Section 3.4 we present two results on the ex- 
istence of a ground state solution for bounded potentials. In the periodic case, one can 
construct bound states having multibumps. The first result of this type is due to Coti Zelati 
and Rabinowitz [48] who constructed positive multibump solutions. Here we present the 
modified approach from [68] which can also be used to obtain nodal multibump-type so- 
lutions and to control the number of nodal domains. So far we always assumed inf V > 0. 
Finally we discuss the case where V is periodic and negative somewhere. The periodic- 
ity implies that the spectrum of —A + V is purely continuous and consists of a disjoint 
union of closed intervals. In Section 3.6 we deal with the case where — A + V has essential 
spectrum below 0. 


3.1. The compact case 


We consider the space EF = {u € H}(RN): Sign V(x)u2 dx < oo} together with the scalar 
product 


wove f vu-vo+ f V(x)uv. 
RN RN 
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In general the embedding from E into L?(IR%) is not compact, for example, when V is 
bounded so that E = H'!(IR"). We present general conditions on V which guarantee that 
the embedding is compact. 

(Vo) V € C(R,R) and infgy V(x) > 0. 

(V1) There exists ro > 0 such that, for any M > 0, 


lim m({x € RY: |x — yl <ro, V(x) < M}) =0, 


ly|>0o 


where m denotes the Lebesgue measure in R. 
Without loss of generality we assume infpw V(x) = 1. 


LEMMA 3.1. Under (Vo) and (V1), the embedding from E into L? (R™) is compact for 
2<p<2"*. 


PROOF. Let (u,) be bounded in E and assume u,;, > 0 weakly in E. We have to show that 
Un > 0 in L? (RY) for 2 < p < 2*. By the interpolation inequality we only need to con- 
sider p = 2. The Sobolev embedding theorem implies Un —> Oin Les Thus it suffices to 
show that, for any ¢ > 0, there is R > 0 such that Ses (0) die <e;here BR(O) = RY \ Br(O). 
Let (y;) be a sequence of points in R% satisfying RN Cc UP Bry (yi) and such that each 
point x is contained in at most 2% such balls B,y(yi). Let Arm = {x € Ba | V(x) > M} 


and Br.w = {x € BR | V(x) < M}. Then 


1 
2 2 
< V ’ 
I... in SM ie ee 


and this can be made arbitrarily small by choosing M large. Choose q such that 2q < 2* 
and let g’ = q/(q — 1) be the dual exponent. Then for fixed M > 0, 


uw< i) 
fs 3 BRuNBy OD 
4 I/q V/q' 
(/ wi) (m (Bra 0 Bry(oi))) 4 
Br MOBroy (yi) 


pape a 


< 
i=l 


»( on 
<er>([ inl) 
Br MOB (yi) 

<ceey fi | (|Vury|? +02) 


Bro (yi) 


< Cep2" i (IVunl? + lunl?), 
RN 
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where &r = sup,, (m(Brou Bry (yi). Assumption (V;) states that er > 0 as 
R— o. Thus we may make this term small by choosing R large. 


Concerning the nonlinearity f we recall the following conditions. 
(fo) f:IRY x R— R is a Carathéodory function with f(x, ft) = o(t) as t > 0. There 
exist C > 0 and p <2N/(N — 2) such that | f(x, t)| < C(|t| + |t|?~!) for all x € 
RY t+eR. 
(f,) For every x € RY, the function R \ {0} > R, tw f(x, 1)/|t], is strictly increasing. 
(f2) There exists 9 > 2 such that 0 < OF (x,t) < f(x, t)t for all x ERY, allt eR. 
The first result is concerned with minimizers of ® on the Nehari manifold 


N = {ue E \ {0}: &(u)u =O}. 


In fact, we find a least energy positive and a least energy negative solution, that is, we 
minimize ® on 


Ne ={ueN: tu > 0}. 


THEOREM 3.2. If (Vo), (V1), (fo) with p < 2*, (£1) and (£2) hold then inf{®(u): u € Ny} 
is achieved, hence (3.1) has a least energy positive solution and a least energy negative 
solution. 


PROOF. Using the compact embedding lemma (Lemma 3.1) the proof proceeds as the one 
of Theorem 1.23. 


Next we consider the nodal Nehari set 


S={u E:uteN,u~ N} 
— {u € E:ut AOAu , ®'(ujut =0= ®'(u)u } 
and find a least energy nodal solution. 


THEOREM 3.3. Suppose (Vo), (V1), (fo) with p < 2*, (f,) and (f2) hold. Then inf ®|g is 
achieved by a nodal solution that has exactly two nodal domains. 


PROOF. Using the compact embedding Lemma 3.1 the proof proceeds as the one of The- 
orem 2.17. 


REMARK 3.4. As commented in Remark 2.18, (f2) can be replaced by the weaker condi- 
tion (f3). This is done in [67]. 


THEOREM 3.5. Assume (Vo), (V1), (fo) with p < 2*, (f1) and (f2). If f is odd in u, 
then (3.1) has an unbounded sequence of nodal solutions ux such that 2 <nod(ux) < k. 


Details of the proofs of these and related results can be found in [12]. 
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REMARK 3.6. Under the stronger condition that tpn V(x)7! dx < oo, a nonlinearity with 
a combination of convex and concave terms was considered recently by Liu and Wang 
in [69] in which multiplicity of nodal solutions was given. 


3.2. The radially symmetric case 


We consider the following class of symmetric functions. We fix a decomposition 
N=N,+---+Ng with N; > 2. For x € RY, we write x = (x1,...,x%) with x; € RX 
and define 


Heym (RY) = {ue H'(RY): u(x) =u(lxrl,.-., bre) }- 


sym 


If k= 1 then H! 


sym (R¥) consists precisely of the radial H'!-functions. 


THEOREM 3.7. The embedding of Hyym(R™) into L? (IR) is compact for 2 < p <2*. 
For the proof we need the following lemma due to Lions [64]. 


LEMMA 3.8. Let (uy) be a bounded sequence in H!(R%). Assume that there is r > 0 and 
2 <q <2* such that 


lim sup sup / |un|4 dx =0. 
B,(y) 


nw yeRN 
Then limn—+oo Jpn \Un|? dx = 0 for 2 < p < 2*. If q =2*, p can be taken as 2*. 
Now we give the proof of Theorem 3.7. 


PROOF OF THEOREM 3.7. Let (u,) be a bounded sequence in Hyym(R™) which we may 
assume converges weakly to 0 in Ayym(RN ). We want to show that (u,) converges to 0 
in L?(R). By Lemma 3.8, if uy, does not converge to zero in L? (IR) there are r > 0, 
6 >Oand yy € R% such that 


timint [ lun|? > 6. 
n> JB, (yn) 


Since the embedding H 1(2) S LP(Q) is compact for bounded domains S2, we have 
|yn| — co. Up to a subsequence we may assume that there is 1 <i <k such that the 
ith components yy j € R: of (y,) go to infinity. Using the radial symmetry in R4, as 
n — oo we find more and more disjoint balls of radius r on which the L? norm of uy is the 
same as J, B(yn) |un|?, contradicting the fact that vu, is bounded in He (RX ) and therefore 


in L?(RY), 
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(S) V(x) and f(x,u) are radially symmetric in each of the variables x; € Ri, 
2 eee a 
If (S) holds then a critical point of ® constrained to Ayym (RN ) is acritical point of @ by 
the principle of symmetric criticality. Thus, with the compactness Theorem 3.7 available 
we easily obtain existence results as in the last section. The proofs are very similar and we 
omit them. 


THEOREM 3.9. Assume (VQ), (fo) with p < 2*, (f1), (f2) and (S). Then the infimum of ® 
on N= Ayym(R%) is achieved, hence (3.1) has a least energy positive solution and a 


least energy negative solution in Ae ae: 


THEOREM 3.10. Assume (Vo), (fo) with p < 2*, (£1), (f2) and (S). Then (3.1) has a nodal 
solution in Ayym(R%) which has exactly two nodal domains. 


THEOREM 3.11. Assume (Vo), (fo) with p < 2*, (f1), (f2) and (S). If f is odd in u, 
then (3.1) has an unbounded sequence of nodal solutions ux, € Hyym(R%) with 
2 <nod(uz) <k. 


REMARK 3.12. If the equation is autonomous then radial solutions have been obtained by 
Berestycki and Lions [25]. The autonomous case has been further investigated by many 
authors. For more recent results, see the paper by Jeanjean and Tanaka [55] and the ref- 
erences therein. Nonradial solutions have been obtained in dimensions N = 4 or N >6 
by Bartsch and Willem [20] provided f is odd and V and f are radial functions of x. In 
dimension N = 5 a nonradial solution can be obtained combining the idea from [20] with 
the concentration—compactness method; see the paper [71] by Lorca and Ubilla. Whether 
or not a nonradial solution exists in dimension N = 3 is open. 


3.3. The steep potential well case 


In this section, we consider potentials depending on a parameter that controls the depth of 
the potential well. More precisely, we want to find bound states of the equation 


(S,) —Aut (Aa(x)+1)u= f(x,u) in RY. 
We require the following assumptions on the potential function Vj (x) = Aa(x) + 1. 
(a1) a: R — Ris continuous, a > 0, 2 := int a~!(0) + @, has smooth boundary and 


Q=a7'(0). 
(a2) There exist Mo > 0 and rg > 0 such that 


lim m({x eR’: Ix-—yl <ro,aQx)< Mo}) <0O, 


lyl>0o 


where m denotes the Lebesgue measure on RN. 
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The set §2 in assumption (a;) is the bottom of the potential well. It is allowed that 2 is 
unbounded. It is also allowed that a is bounded. In view of the results and the proofs 
from the last section we need to study the compactness of the problem first. On the space 
E={ue H'(R%): tpn a(x)u? dx < co} we use the norms 


Iu = [ver + (Aa) +1)u2)dx for A > 0, 


which are equivalent norms on E.. We shall occasionally write E, for the Hilbert space E 
equipped with the norm || - ||,. The functional associated to (S,,) is given by 


®,(u) = 5 f lita +a(acs) + 1)u?) dx -[, F(x,u)dx 
1 2 
= simi — f F(x,u)dx. (3.2) 
RN 


If (fo) holds we have ®, € C!(E,, R) for any 4 > 0. We have the following parameter- 
dependent compactness result for ®,. 


PROPOSITION 3.13. Suppose (a1), (a2), (fo) and (f2). For any Co > 0 there exists Ap > 0 
such that ®), satisfies the (PS)--condition for all } > Ao and all c < Co. 


Since the proof of Proposition 3.13 is rather technical we just refer the reader to [13,16]. 
The result should also be compared with Theorem 3.1 in which global compactness is 
given. 


THEOREM 3.14. Assume (a1), (a2), (fo) with p < 2* and (f2). Then for large, (S)) has 
a positive solution and a negative solution. 


PROOF. If, in addition, (f;) holds then one obtains the positive and the negative solution 
by minimizing on the positive (resp. negative) Nehari manifold as before, using the com- 
pactness result from Proposition 3.13. If (f;) does not hold one may apply the mountain 
pass theorem instead of minimizing. 


THEOREM 3.15. Assume (a1), (a2), (fo) with p < 2*, (f1) and (f2). Then for x large, 
(Sa) has a nodal solution which has exactly two nodal domains. 


PROOF. Here we minimize on the nodal Nehari set associated to the problem and ob- 
serve that at the minimal level the Palais—Smale condition holds for A large by Proposi- 
tion 3.13. 


Details of the proofs of these two results can be found in [13,14]. 


THEOREM 3.16. Assume (aj), (a2), (£5) with p < 2*, (f,) and (f2). If f is odd in u, 
then, for any integer k, there is A, such that for 1 > Ax, equation (Sj) has k pairs of 
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nodal solutions uj, j =1,...,k, such that the number of nodal domains of uj is bounded 
by j +1. 


For the existence of multiple nodal solutions we need to use a combination of a minimax 
procedure and invariant sets of the gradient flow as was done in [12]. We define K)(u) := 
(-—A+ Vir he u), and consider the flow on E associated to 


oni (u) = —ni (uw) + Ki (niu), 
n(u) =u. 


We claim that the cones P~ = {u € E: +u > 0} are K,-attractive in the sense of Defini- 
tion 2.6. This is in fact independent of A. For any M C E and ¢ > 0, M, denotes the closed 
e-neighborhood of M, i.e., 


M, := {u € E: dista(u,M) < eh. 


LEMMA 3.17. Assume (a1), (a2) and (fo). Then there exists &9 > 0 such that 


K,((P*),) Cc int((P*),) forall0<e<eo,rA ZF 0, 


so P~ is K)-attractive uniformly in 2. Consequently, 


n((P*),) C int((P*),) for allt > 0,0 <€ < eq andi 20. 


PROOF. We write V(x) = Aa(x) + 1. For u € E, we denote v = K,(u) and ut = 
max{0, uv}, u~ = min{0, uv}. Note that, for any uw € EF and2 <p <2", 


lu lite = inf |lu— wllpe. (3.3) 
wePt 

Since 

lv |Z =Q, v0 Da = (Vu- Vu + V,vv~) dx at f(x,u)u” dx, 

RY RN 

the fact that vt € P* and v— vt = v7 implies 

dist,(v, P+) Werth WIR < f Fonuryor a. 3.4) 

RY 


As a consequence of (fo) there exists a 6 > 0 and C; > 0 such that 


f(x,s) > —8)s+C\|s/? 2s fors <0. 
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Thus 


i f(x,u_)v- dx 
RY 


<[ (C1 — 8)u7 + Cy|u7 |? ~2u-) ur dx 
RN 


< (1 = 8) lu U2 lho U2 + Callen Woe NUT Up (3.5) 


From the Sobolev embedding and (3.3)—(3.5), 


dist, (v, P*) + |lu~ lla 


2*-1 


< (1-8) a lu — wilzzilv Ila + Co nk lu — wr» tooth. 
which implies (if ||v~ ||, 40) 
: + = : _ : ion 1 
dist, (v, P*) < (1-8) int, Ju — wllp2 + C2 inf, lu — wih os 
< (1-8) inf. lu—wll,+C3 inf. jw — wi?! 
wePt wePt 


= (1 —8)dist,(u, P*) + C3(dist,(u, P*))” 


Therefore, there exists ¢9 > 0 such that if dist, (u, P*) < eg then 


dist, (v, P*) < dist), (u, P*): 


The proof of Theorem 3.16 is based on Lusternik—Schnirelmann methods similar to 
those used in the proof of Theorem 2.24 and the above compactness result. 


REMARK 3.18. Theorem 3.16 still holds when one replaces the potential Aa + 1 by 
Aa + ag with ap € L® (RY) and such that — A + ao is invertible. In this case O is a saddle 
point instead of a local minimum of the functional. The invariant sets given in Lemma 3.17 
do not work, but one can use the invariant sets constructed in [66] in this case. 


3.4. Ground state solutions for bounded potentials 

In this section we consider bounded potentials V which cause some compactness problems. 
We shall present two results on the existence of a ground state solution. In order to keep 
the presentation simple we only deal with the case of a homogeneous nonlinearity. Thus 
we want to find a ground state solution u €¢ E = H'(RY) of the equation 


—Au+V(x)u = lulu, (3.6) 


where 2 < p < 2*. We shall first treat a periodic potential and assume 
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(V3) V is 1-periodic in each of its variables. 
The case where V is 7;-periodic in xj, i = 1,...,k, can be easily reduced to the period 1 
case. 


THEOREM 3.19. Assume (Vo) and (V3). Then (3.6) has a least energy positive solution. 


PROOF. We consider the following minimization problem on E = H! (RN): 


m= int [ |Vul? + V(x)u2dx, M={ueE: |lullz» =1}. 
ueM JRN 


The Sobolev inequality implies m > 0. A minimizer of m gives a solution of (3.6) by a 
simple scaling factor. We show next that m is achieved. Let (u,,) be a minimizing sequence 
for m. Then up to a subsequence u, — u weakly in E. Since ||u,||L2 = 1, by Lemma 3.8 
there is r > 0, 6 > 0 and (y,) C R™ such that 


timint [ |uy|? >. 
n> JB, (yn) 


By increasing r we may assume that all y, have integer coordinates. Setting v,(x) = 
Un(X + yn) we see that (v,) is also a minimizing sequence for m because V is periodic. 
After passing to a subsequence we may assume that v, —> v weakly. It follows from 


timint [ lun|? > 6 
noo JR (0) 


that v £0. If ||v||,2 = 1 we are done. If ||v||,2 < 1 we produce a contradiction as follows. 
By the Brezis—Lieb lemma we have 


1=|lun— vf, + lulz, +o) asn—> oo. 


Set a = ||v||?, so that ||vp vil p >l-aasn>ow. 
m-+o()= [ [Vonl? + V(x)lvnl” 
RN 


=u) IvoP+ venir + f |VOn — v) 7 + V@)lun — vl? + 0(1) 
RN RN 


> m(llvilZo + llun — vilz>) + oC). 


Passing to the limit we get m > m(a’/? + (1 — a)*/?), a contradiction. 


Now we consider nonperiodic potentials satisfying 
(V4) limjx|+ 00 V(x) = Voo := SUPpw V(x) < 00. 


THEOREM 3.20. If (Vo) and (V4) hold then (3.6) has a least energy positive solution. 
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PROOF. We consider again the minimization problem on E = H!(R), 


m:= int [ |Vul* + V(x)u? dx 
ueM JRN 


and compare it with 


Moo = inf i |Vul? + Voou? dx, 
ucM JRN 

where M = {u € E: ||u||_? = 1} is as before. The Sobolev inequality yields m > 0, and it 
is easy to see that a minimizer of m gives a solution of (3.6). If V(x) = Voo we may use the 
last theorem to get the existence of a positive solution. Thus we may assume V(x) < Voo 
somewhere. Then using the minimizer of mo as a test function we obtain m < moo. We 
show next that m is in fact achieved on M. Let (u,,) be a minimizing sequence for m. Then 
up to a subsequence u, — u weakly in E. Since ||u,,||,» = 1, by Lemma 3.8 there exist 
r >0,6 >0and (y,) C R% such that 


timint [ unl? > 8. 
ma By (Yn) 


We claim that there exists a bounded sequence (),,). If this is not true, we have u = 0 and 
un > Oin Li (RY). Then 


loc 


m-+o)= | [Vun|> + V(x)|unl? dx 
RN 
= [Vu + VocluniPad + f (V(x) — Voo) ln |? dex 
RN RY 


= i |Vutn|? + Voolun|” dx + 0(1) 
RN 
> Mo + 0(1). 
Passing to the limit we have a contradiction with m < moo. Thus we proved that (y,,) is 


bounded which implies u 4 0. If ||u||z» = 1 we are finished. If ||u||_» < 1 we can produce 
a contradiction as in the proof of the last theorem. 


3.5. More on periodic potentials 
In this subsection we describe the multibump type solutions for the periodic nonlinear 
Schrédinger equation constructed by Coti Zelati and Rabinowitz in [48] and recent gener- 
alizations of the results by Liu and Wang in [68], 

—Au+V(x)u= f(x,y). (3.7) 


Throughout this section we assume (V3), (£4), (f2) and 
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(Vo) Ve C!(RY,R) and infgw V(x) > 0. 
(f6) f € C!(R® x R,R) is 1-periodic in each of its x-variables. 
The periodicity conditions imply that (3.7) is Z -invariant. The weak solutions of (3.7) 
correspond to critical points of 


P(u) = 5 fia + V(x)u?) dx -{f, F(x, u)dx 


in E = H'!(R%). Define the mountain pass value c as 


c= inf sup ®(g(t)), 
8€l te(0,1] ( ) 


where 
DP ={ge€C((0, 1], Z)| g() =0, &(g(1)) <o}. 


In the homogeneous case f(x, u) = |u|?~7u this is just the minimizer of ® on the Nehari 
manifold. In [48] it was proved that (3.7) has infinitely many k-bump solutions. In partic- 
ular, we have the following theorem. 


THEOREM 3.21. ere /ZN is infinite for any k > 2, provided the following condition is 
Satisfied: 
(*) there is o > 0 such that K°+"/ZN is finite. 


Here KC? denotes the set of critical points of ® between the levels a and b. 

In [48,68] it is proved that oe /ZN contains infinitely many nodal solutions. There 
one can also find estimates on the number of nodal domains of these multibump type 
solutions. 

In the following we review the modified approach given by Liu and Wang in [68]. This 
modified approach gives the one sign solutions and the nodal solutions in a uniform fash- 
ion, and it is easier for obtaining estimates on the number of nodal domains compared with 
the original approach by Coti Zelati and Rabinowitz [48]. 

For a > 0, the a-neighborhood of a set A C E is defined by 


Na(A) = {u EE: |lu— All < a}, 


whose closure and boundary are denoted by N,(A) and 9N,(A), respectively. For j = 
(j1,-.., in) € ZN, we define the translation on R” by 


Tju(x) =u(x + fi,...,xN + jn). 
For a finite subset E, of E and an integer / > 1, we denote 


Jj 
T(E) = I: l<j<l,vu; € E,ki ex} 
i=1 
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Consider the positive cone P* and the negative cone P~ in E defined by 


P~={ue E: tu >0}. 
Any u €K \ (Pt U P-) will be a nodal solution of (3.7). 


LEMMA 3.22. (i) there is v > 0 such that |\u|| > v for allu € K \ {0}; 

(ii) there is c > 0 such that ®(u) >c forall u € K \ {0}; 

(iii) for all u € K \ {0} with ®(u) < b: |lul| < (26b/(6 — 2))'/; 

(iv) for any b > 0, there is vj > 0 depending on b such that \|u~||;2¢an) 2 v1 for all 
ucK\(Pt UP) with ®(u) <b. 


See the proofs in [48] and [68]. 

Let A: E > E be given by A(u) := (-A+ V)'LFG, u(-))] for uw € E. Then the gra- 
dient of ® has the form ®’(u) = u — A(u). Note that the set of fixed points of A is the 
same as the set of critical points of ®, which is K. By the proof of [48], Proposition 2.1, 
®': E — E is locally Lipschitz continuous. 

Using Lemma 3.17, the behavior of PS sequences in the whole space E as well as 
in Na (P*) can be studied. 


LEMMA 3.23. Let (Um) C E be such that ®(um) > b > 0 and ®'(um) — 0. Then there 
is an € N (depending on b), v1, ..., v7 € K \ {O}, a subsequence of um and corresponding 
ki, € ZN, i=1,...,1, such that 


Um — >. Ti Vi >0 am>o, (3.8) 
i=1 
l 
di) =, (3.9) 
i=1 
and fori F j, 
|ki, — keh] > 00 asm— oO. (3.10) 


Moreover, there exists an a, € (0, ag] (depending on b) such that if (Um) C Na, (P*) 
(Na, (P7), resp.) then v1,...,1 € (K \ {ON Pt ((K \ {0}) N Po, resp.). 


For a € [0, a1], we define 


Ta = {g €C((0, 11, Na(P*)): g(0) =0 and &(g(1)) <0} 


and 


c, = inf max @(g(6)). 
* ger 9€[0,1] (3) 
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For a = 0, Na(P*) = P*. In this case, we denote ['~ = I and c* =cg. Then we can 


prove that cy is independent of a for a small. 


LEMMA 3.24. There exists az € (0, a1) such that cy = c~ for all a € (0, a2]. 


Denote K' = KN P! for i € {+, —}. We will also use the notation: (K')? = K'N ®&?, 
(Kye =Kin o? and Ki(c!) = K(c!) N P! for i € {+, —}. Instead of (*), we need the 
following condition. 

(*)4 There is a > 0 such that (K+) +%/Z is finite. 

Choose a representative in E from each equivalent class in (K')“+%/Z" and denote the 
resulting set by F’,i € {+, —}. Let c > 0 be the number from Lemma 3.22 which satisfies 
@(u) > c for all u € K \ {0}. Denote /~ = [(c* + a)/c]. According to [48], Proposi- 
tion 2.57, (Zj+(F*)) = inf{||u — w||: wu 4~ w € T+(F*)} > O. Using this a deformation 
lemma in N,(P*) can be given. The proof of the deformation lemma is similar to the 
proof of [48]. However, we need to construct a descending flow of ® which makes Na (P') 
positively invariant so that the deformation is from N,(P') to itself. 

Then by using the descending flow, one obtains the following theorem which asserts the 
existence of one-bump positive and negative solutions at the mountain pass level. These 
one-bump solutions will be used later to construct multibump nodal solutions. 


THEOREM 3.25. Let («)+ be satisfied. Then c~ are critical values of ® and there are 
critical points u~ € K~ such that B(u*) = c~. 


REMARK 3.26. This theorem shows the existence of a solution near the mountain pass 
level regardless of whether (:)+ is satisfied or not. 


Now, by (*)+, there is an a; € (0, a) such that 


(=e): 
LEMMA 3.27. Let (*)4 be satisfied. Then there exist is sets At C Kt*(ct) and 
A~ CK (c_) having the property that for any €, <a /2,71 < pu (F~)) and pe N, 
there is an €, € (0, €) and 8 € I~ such that 

(i) maxgero,1] P(g] (0)) <c™ + €1/p; 

(ii) if (gy (6)) > c* — e then gy (0) € N,, (A*). 


Let A= At U A~ with A* given in Lemma 3.27. For any fixed integer k > 2 we 
fix two positive integers kt and k~ such that k =k* +k~. Denote AT = {1,...,k7}, 
A~ ={kT +1,...,k}. Let jj € ZN fori =1,...,k be fixed such that di X# jm boron 
and if v; € At fori €¢ At and v; € A~ fori € A~ then 


o(e Tj n)- (ktct +k-c7) 


kv 
>— and 
2 


k 
ei 
i=l 


a 
oa 
2 
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Define 

M(it,-+-5 dks AvKT LK) 

k 
= ye v; € At forie At, vu; € A” forie | 
i=1 

and 

be=k*ct+kc. 

The main theorem in [68] reads as follows. 


THEOREM 3.28. Let (*)4 be satisfied. Then there is an ro > 0 such that, for any 
ré (0,70), 


Ne(M (Lit, «++ Lies Akt K-)) 0 (KEEPS /ZN) £G 


by —a 


for all but finitely many | € N. 


We sketch the proof of Theorem 3.28. For 0 = (6),...,%) € [0, i}*, let 0; = (1, 
..-, 91,0, O41, ..-,O%) and 1; = (@,..., A-1, 1, O741,..., 9%), 1 <i <k. Let az be as 
in Lemma 3.24 and a € [0, az] and define 


Iy(a) = {G = g, +--+ + gx: gj satisfies (g})-(g3), 1 <i <k}, 


where 
(g1) gi € C((0, 1]*, Na(P*)) for i € A*, 
(g2) 9)(;) =0 and &(g;(1;)) <0, 1 <i <k, ae 
(g3) there are bounded open sets O;, 1 <i <k, such that O; 1 O; =@ if i A j and 
supp gi (0) C O; for all @ € [0, 1]*. 


LEMMA 3.29. Let (*)+ be satisfied. Define 


by(a)= inf max ®(G(6)). 
Gely,(4) 6€[0, 1} 


Then by(a) = by =k* ct +k-co fora € (0, az]. 


From here on we argue by contradiction. Thus assume that there are infinitely many / 
such that the conclusion of the theorem is false. The proofs go with the construction of a 
special G, which is chosen as close to the level by (a) as possible, the deformation of this 
special G under the gradient flow, modification of the deformed G so that finally we get 
a map in the family [;,(a) satisfying max ®(G) < bx, which is a contradiction with the 
definition of b;, (a). We refer for the details to [68]. 

Next we state a result of [48,68] which is used in establishing more detailed nodal prop- 
erties of these solutions. 
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THEOREM 3.30. In the above theorem, if r is sufficiently small and | sufficiently large, we 
may replace the r-neighborhood in E with r-neighborhood in X := C\(RN). 


The proof of this uses some elliptic estimates. 


THEOREM 3.31. Suppose (*)+ holds. For multibump nodal solutions of (3.7), the number 
of nodal domains is bounded by the number of bumps. In particular, the two-bump nodal 
solutions have exactly two nodal domains. Moreover, there are infinitely many, geometri- 
cally different, two-bump, nodal solutions which have exactly two nodal domains. 


The proof of this theorem is a consequence of the following lemma from [68]. 


LEMMA 3.32. [fr is small enough and | is large enough then, for the solutions u given in 
Theorem 3.28, the number of nodal domains is bounded above by the number of bumps of 
the solutions. 


The techniques for the above theorem can be used to establish the nodal property of the 
solutions in another two cases. First, we consider (3.7) on a cylinder domain 2 =w x R 
and we write x = (x’, xy) with x’ = (x1,...,xy—1), where w is a bounded smooth domain 
in R‘—!. We assume (Vo), (fp). (f2), (f3), and (V5) and (f6) are satisfied with the period- 
icity only in the xy direction. The space will be E = Hy (2). Then we can still define the 
mountain pass values c~ > 0. The problem now is Z invariant. 

(«’)4 There is a > 0 such that K° +” /Z is finite. 


THEOREM 3.33. Suppose (*')+ holds. Then, for any integers k >m > 2, (3.7) has in- 
finitely many, geometrically different, k-bump, nodal solutions in as which have ex- 
actly m nodal domains. More precisely, given any positive integers k,, k2, ..., Km such that 


yr ki = k > 2, there are infinitely many, geometrically different, k-bump, nodal solu- 


tions in tiga which have exactly m nodal domains Dj, i = 1,...,m, such that u|p, is a 


k,;-bump positive or negative solution. 


Another case can be considered is when (3.7) has different x-dependence in different 
directions. We assume (Vo), (£))s (f2), (f3) and 


(Vs) V is periodic in xy and radially symmetric in (x1,...,*N—1). 
(f7) f €C!(R x R,R) is periodic in xy and radially symmetric in (x},...,xy—1)- 
Then Z acts via translations on the x,-variable, and the problem is Z-invariant. With 
x = (x',xy) and x’ = (x1,...,xy—1), we work with the space 


E= {« € H'(RY): u(x’, xw) = u(|x’ sw). ff V(x)u? dx < oo}, 
RN 


that is, functions in E are radially symmetric in the first N — 1 variables. We can still define 
the mountain pass values c~ in the space E. 
(*")4 There is a > 0 such that K° *%/Z is finite. 
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THEOREM 3.34. Suppose (*”)+ holds. Then for any integer k > 2, (3.7) has infinitely 
many, geometrically different, k-bump nodal solutions in pee such that the numbers of 
their nodal domains are bounded between [k/2]+ 1 and k. In particular, there are nodal 


solutions such that the numbers of their nodal domains tend to infinity. 


We refer the details of the proofs to [68]. 


3.6. Strongly indefinite potentials 


In this section we consider problem (3.1) when V and f/f are periodic in the x-variables 
but V is not positive anymore. For periodic V the operator —A + V has a band spectrum. 
More precisely, the spectrum of —A + V on L?(RY) is purely continuous, bounded below 
and consists of a disjoint union of closed intervals. We require: 

(V5) V €C(RN, R) is 1-periodic in each of its variables and the linear operator, 


H?(R%) > L?(R%), ur —Au+V(x)u, 


is invertible. 
By (V5) the operator —A + V(x) is self-adjoint on L?(RN ) and may have continuous 
spectrum on the negative real axis with 0 in a spectral gap. 


THEOREM 3.35. Suppose (V5) and (fo) with p < 2*, and (f2) hold. Then problem (3.1) 
has a nontrivial solution in H'(RN). 


Theorem 3.35 is due to Kryszewski and Szulkin [58]. An earlier version requiring a 
stronger growth condition on f has been obtained by Troestler and Willem [89]. If 0 is 
a left end point of a spectral gap, that is 0 € 0(—A+ V) and (0, ¢) CR\o(—A+ V) then 
a solution of (3.1) has been found in [11] under additional growth conditions on f. The 
solution then does not lie in H! (RY) but only in Hy. (RY) N L4 (RY) for p<q <2". 


THEOREM 3.36. Suppose (V5) and (fo) with p < 2*, and (f2) hold. If in addition f is odd 
in u then problem (3.1) has infinitely many geometrically different solutions in H' (RN). 


Here two solutions uj, v2 are said to be geometrically different if there does not exist 
k €Z" with u2(x) =u,(x +k) for every x € R%. Also Theorem 3.36 is due to [58] and 
has been extended in [11] to the case where 0 is a left end point of a spectral gap. 
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Abstract 
We study existence of minimizers for problems of the type 


in| f f (x, u(x), Du(x)) dx: u€ug+ Wy? (2: Ry], (P) 
2 


where ug is a given function. 

After recalling some basic facts about existence of minimizers when the function f is 
convex (quasiconvex), we turn our attention to the case where f is not convex (quasiconvex). 

We start by presenting the general tool of relaxation, which gives generalized solutions 
of (P). 

We next discuss some differential inclusions, where we look for solutions u € ug + 
Wo"? (2: RN) of 

Du(x)EE ae.inQ, 

where E C RN*" is a given compact set. 

Finally combining the relaxation theorem and the study of differential inclusions, we give 


necessary and sufficient conditions for existence of classical minimizers of (P) as well as 
several examples. 
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1. Introduction 


We discuss the existence of minimizers for the problem 
in| r0) = i f(x, u(x), Du(x)) dx: ueugt Wo? (2; Rr”), (P) 
Q 


where 
e §2. CR’ isa bounded open set, with Lipschitz boundary 02; 
eu: 2—>RQ, 


u=u(x)=u(xX1,...,Xn) = (u' (x), seas uN (x)) 
(if N = 1 or, by abuse of language, if n = 1, we will say that it is scalar valued while 


if N,n > 2, we will speak of the vector valued case); 
e Du denotes its Jacobian matrix, 1.e., 


aul au! 

a yi \ 1SiSN Ox] OX 
pu=(¢ ) = e202 hei 

a I<jxn au’ whys, au’ 

Ox] OXn 


e f:2x RN x RX*" — Ris continuous, f = f(x, u, €); 
e l<p<oand WLP(Q; RY) denotes the usual space of Sobolev maps, where 


. du! 
ul, wey EP), Fon eae er es eee 
J 


e uy € W!?(Q; RY) is a given map; 
euecugt Wy? (2; RY), meaning that u € W!-P(Q; RY) and u = uo on O82 in the 
Sobolev sense. 
This problem is the fundamental problem of the calculus of variations and it has received 
a considerable attention since the time of Fermat, Newton, Bernoulli, Euler and all along 
the 19th and 20th centuries. 
The most general way of proving existence of minimizers of (P), meaning to find u € 


uo + Wy? (2; RY) so that 
T@) <1) 


among all admissible u € ug + Wy? (2; RY), is the so-called direct methods of the calcu- 
lus of variations. These methods rely on some kind of convexity condition of the function 
& — f(x,u,&). There are numerous examples showing that in absence of convexity the 
problem (P) has no minimizers. At the moment let us quote three elementary examples 
where nonexistence occurs. 
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EXAMPLE 1. Let N=n=1, 
f(x,u6)=f@=e" 
and 
in| 100 = [ f (u(x) dx: we Wy, |. (P) 
EXAMPLE 2. Let N=n=1, 
f(x,u,£) = fu, §) =u4 + (6-1) 
and 
in| 10 =f f (u(x), u'(x)) dx: we WoO, v}. (P) 
This example is due to Bolza. 
EXAMPLE 3. Letn=2, N=1, 2 =(0,1)’, 
f(x,4 = fO= feo) =(-1) +8 
and 
int { 70) =| #(Duc0) dx: ue wea], (P) 


We now continue this introduction by discussing only the scalar case (i.e., when N = 1 
or n = 1), the general vectorial case will be discussed in the next sections. We moreover, 
in order to simplify the presentation, consider the case where there is no dependence on 
lower-order terms, i.e., f(x, u,&) = f(&). 

When dealing with nonconvex problems, the first step is the relaxation theorem, es- 
tablished by L.C. Young, Mac Shane, Ekeland and others. This consists in replacing the 
problem (P) by the so-called relaxed problem 


int{ Te =i, Cf (Du(x)) dx: wu € uo + wa}, (QP) 
2 
where Cf is the convex envelope of f, namely 


Cf =sup{g < f: g convex}. 
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Therefore the direct methods, which do not apply to (P), apply to (QP). It can be shown 
(cf. Theorem 15) that 


inf(P) = inf(QP) 


and that minimizers of (P) are necessarily minimizers of (QP), the converse being false. In 
the three above examples we have 
G) Cf(&) =0, inf(P) = inf(QP) = 0 and any u € Wy! (0, 1) is a solution of (QP); 
(ii) Cfu, €) =u* + [&? — 1], inf(P) = infQP) = 0 and uw = 0 is a solution of (QP); 
(ii) Cf(§) = [é? — ges + é, inf(P) = inf(QP) = 0 and u = 0 is a solution of (QP); 
where, for x € R, 


ix] fe if x >0, 
XxX = 
+ lo ifx <0. 


The second step in proving the existence of minimizers for (P) is to see if among all 
solutions of (QP), if any, at least one of them is also a solution of (P). This amounts in 


finding i € uo + Wy’? (2) so that 


/ Cf (Dii(x)) dx = inf(P) = inf(QP) 
2 


and at the same time in solving the first-order differential equation (called, following 
Dacorogna and Marcellini [31], implicit partial differential equation) 


Cf (Di(x)) = f(Dii(x)) ae.x€ 2. 


After this brief and informal introduction, we discuss the organization of the article. 

In Section 2 we discuss all the notions of convexity that are involved in the vector valued 
case, in particular the so-called quasiconvexity. 

In Section 3 we present the relaxation theorem in the vector valued case, introducing all 
the needed generalization of the notion of convex envelope. 

In Section 4 we give some existence theorems for implicit differential equations of the 
above type. 

In Section 5 using the results of the two preceding sections, we discuss necessary and 
sufficient conditions for the existence of minimizers for nonconvex problems. 

In Section 6 we show how to apply the abstract results to scalar problems; obtaining 
sharper theorems in the case of single integrals (i.e., 7 = 1). 

In Section 7 we present several examples involving vector valued functions (i.e., 
n, N > 2) which are relevant for applications. 

The subject is very large and we do not intend to be complete and we refer to the bibli- 
ography for more details. Let us quote some of the significant contributions to the subject. 

The scalar case (n = 1 or N = 1) has been intensively studied notably by Aubert and 
Tahraoui [4-6], Bauman and Phillips [10], Buttazzo, Ferone and Kawohl [13], Celada and 
Perrotta [14,15], Cellina [16,17], Cellina and Colombo [18], Cesari [20,21], Cutri [22], 
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Dacorogna [26], Ekeland [39], Friesecke [40], Fusco, Marcellini and Ornelas [41], 
Giachetti and Schianchi [42], Klétzler [47], Marcellini [50-52], Mascolo [54], Mascolo 
and Schianchi [56,57], Monteiro Marques and Ornelas [58], Ornelas [64], Raymond 
[67-69], Sychev [75], Tahraoui [76,77], Treu [78] and Zagatti [80]. 

The vectorial case has been investigated for some special examples notably by Allaire 
and Francfort [3], Cellina and Zagatti [19], Dacorogna and Ribeiro [35], Dacorogna and 
Tanteri [37], Mascolo and Schianchi [55], Miiller and Sverak [61] and Raymond [70]. 
A more systematic study was achieved by Dacorogna and Marcellini in [27,31,32], as well 
as in Dacorogna, Pisante and Ribeiro [34]. 

We have always considered in the present article the two important restrictions: 

e f does not depend on lower-order terms, 1.e., f(x, u,&) = f (&); 

e the boundary datum wo is affine, i.e., there exists & € RY *" so that 


Dug = &0. 


In the above-mentioned literature, some authors have considered either of these two 
more general cases. The results are then much less general and essentially apply only to 
the scalar case. 


2. Preliminaries and notations 
2.1. The different notions of convexity 


We start with the different definitions of convexity that we will use throughout this chapter 
and we refer to Dacorogna [26] for more details. 


DEFINITION 4. (i) A function f :R‘*”" > R = RU {+00} is said to be rank one convex 
if 


f (AE +L —A)n) SAFE) +0 -A FM) 


for every 4 € [0, 1], €,n € R“*” with rank{é — n} <1. 
(ii) A Borel measurable and locally integrable function f :R‘*" — R is said to be 
quasiconvex if 


1 
FE) < —— | f(E + De(x)) dx 
D 


meas D 


for every bounded domain D C R", for every € € R“*" and for every y € Wy CDSs 
(iii) A Borel measurable and locally integrable function f :R‘*” — R is said to be 
quasiaffine if f and — f are quasiconvex. 
(iv) A function f :RN*”" > R = RU {+00} is said to be polyconvex if there exists 
g: RR’) —. R convex, such that 


f(@)=8(T), 
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where T : RN *" — R’) is such that 


T() = (&, adjyé, seeo adjnnn§)- 


In the preceding definition, adj, stands for the matrix of all s x s minors of the matrix 
&e€RN*".2<5<nAN =min{n, N}, and 


nAN 


t(n,N)= )° o(s), 


s=1 


=e N!n! 
TVEN Bie) nt GEO! 


REMARK 5. (i) The concepts were introduced by Morrey [59,60], but the terminology is 
the one of Ball [7]; note however that Ball calls quasiaffine functions, null Lagrangians. 
(ii) These notions are related through the following diagram 


where 


f convex =>  f polyconvex 


=> ff quasiconvex => ff rank one convex. 


In the scalar case, n = 1 or N = 1, these notions are all equivalent and reduce therefore to 
the usual notion of convexity. However in the vectorial case, n, N > 2, these concepts are 
all different, meaning that there are counterexamples to all the above implications. The last 
counter implication being known, thanks to the celebrated example from Sverak [72], only 
when n > 2 and N > 3; the case N =2, n > 2 being still open. 

(iii) Note that in the case N =n = 2, the notion of polyconvexity can be read as fol- 
lows: 


| t(n, N) =1(2,2)=5_ sincea(1) =4, o (2) = 1, 
T(§) = €&, det). 


(iv) Observe that, if we adopt the tensorial notation, the definition of rank one convex- 
ity can be read as follows, 


g(t) = f(E+ta®b) 


is convex in t for every € € R“*" and for every a € R", b € R”, where we have denoted 
by 


_ (i 1<i<N 
a@b= (a ba) cacn* 


(v) One should also note that in the definition of quasiconvexity if the inequality holds 
for a given domain D C R", then it holds for every such domain D. 
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(vi) If the function f :R”*”" > R, ie., f takes only finite values, is convex or poly- 
convex or quasiconvex or rank one convex, then it is continuous and even locally Lipschitz. 
(vii) It can be shown that a quasiaffine function is necessary of the form 


fE)=(e; TE) +B 


for some constants a € R‘ and 8 € R and where (-; -) stands for the scalar product in R‘; 
which in the case N =n = 2 reads as (@ = (111, Q12, 21, 22, U5) € R°) 


2 


SE) = Yo oujkij +05 detE + B. 


ij=l 


(viii) An equivalent characterization of polyconvexity can be given in terms of the sep- 
aration theorem (cf. Theorem 1.3 in Dacorogna [26], p. 107). A function f :R‘*" > Ris 
polyconvex if and only if for every  € R"*" there exists 4 = A(E) € R™™” 0 that 


fE+n) — fE)—(4s TE +n) -TE))>0 for every ne RN*". (1) 


(ix) When the function f depends on lower-order terms as in the Introduction, i.e., 
f:2 x RN x RN*" — R with f = f(x, u,&), all the above notions are understood only 
with respect to the variable &, all the other variables being kept fixed. For example in the 
case of quasiconvex functions, one should read 


1 
meas D 


Fest) < ie f (xo. uo, § + Do(x)) dx 


for every bounded domain D C R", for every (xo, uo, €) € 2 Xx RY x RY** and for every 
g € Wy? (D; RY). 


The important concept from the point of view of minimization in the calculus of vari- 
ations is the notion of quasiconvexity. This condition is equivalent to the fact that the 
functional J, defined in the Introduction, is (sequentially) weakly lower semicontinuous 
in W!-?(Q; RY) meaning that 


I(u) < liming I (uy) 
v—> oo 


for every sequence u, — u in W!?, 
Important examples of quasiconvex functions are the following. 
(i) The quadratic case. Let M be a symmetric matrix in RY *”*(*”) and 


f(E) = (ME; &), 
where € € R"*” and (-; -) denotes the scalar product in RY *". Then 


f quasiconvex <> ff rank one convex. 
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(ii) The Alibert-Dacorogna—Marcellini example (cf. [2]). Here we have N =n =2 
and 


Ff) =lEP (lel? — 2y deté), 


where |&| stands for the Euclidean norm of the matrix and y > 0. Then 


2 
fisconvex => yey 3V2, 
f ispolyconvex <= > y<yp=l, 
f isquasiconvex <=> y<y, where y, > 1, 


f isrank one convex <> yCy= 


(iii) Let f :RY*" > R, &:R‘*" — R be quasiaffine and g:IR > R be such that 
f&) = 8(%@)) 
(in particular if N =n, one can take ®(€) = deté), then 


f polyconvex <> ff quasiconvex 


<=> frankoneconvex <> g convex. 
(iv) Let N=n+1 and for é € R“+)*", denote 
adj,,& = (deté', —det&,..., (—1)**! det&*,..., (—1)"** deté”*"), 
where é k is the n x n matrix obtained from & by suppressing the kth line (when & = Du, 


adj,, Du represents, geometrically, the normal to the hypersurface). Let g: R"+! _, R be 
such that 


FE) = 8 (adj, €) 
then 


f polyconvex <> ff quasiconvex 
<=> frankoneconvex <> g convex. 
(v) Let 0 < AV(E) <--- < An(E) denote the singular values of a matrix — € R’*", 


which are defined as the eigenvalues of the matrix (££ ')!/*. The functions 


> aig) and €>][A), v=l,....a, 


i=v i=v 
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are respectively convex and polyconvex (note that []/_, 4;(€) = | det |). In particular, the 
function € — i,,(&) is convex and in fact is the operator norm. 

2.2. Some function spaces 

The following notations will be used throughout. 


e For! < p<, we will let W!-P(Q; RY) be the space of maps u: 2 Cc R" > RY 
such that 


€ L?(2,RN*"). 


ai \ 1Si<N 
u€ L?(2,R) and pu=( ) 


OX) J 1<j<n 

e Forl<p<o™, Wy? (2; IR”) will denote the closure of cs (2; RY) with respect 
to the || - || yi. norm. 

Wy’ (2; RY) = WE (2; RY) 1 Wy’ (2; RY). 

Af frice(Q: RY) will stand for the subset of W''°(@; RY) consisting of piecewise 
affine maps. 

e Chiec (2; IR) will denote the subset of W!°(Q; RY) consisting of piecewise 


C! maps. 


2.3. Statement of the problem 


We will be concerned with existence of minimizers for the problem 


int{ [ f (Du(x)) dic: u € ug + Wy’ (2; Rr”), (P) 
Q 


where 
e §2 CR” is a bounded open set with Lipschitz boundary, 
e u:8—> RN and thus Du e RN*", 
e f:RN*" — Ris lower semicontinuous, locally bounded and nonnegative, 
e & €R*" and Ug, 1s an affine map such that Dug, = 0. 
The hypothesis f > 0 can be replaced, with no changes, by 


f(&)>(a;TE))+B foreveryé eRN*", 


for some constants a € R‘ and 6 € R and where (-; -) stands for the scalar product in R’. 
This hypothesis is made to avoid to have to deal with quasiconvex envelopes Of = —ov. 


3. Relaxation theorems 


We now present the relaxation theorem, which corresponds to the first step described in the 
Introduction. But before that we need to introduce the notions of envelopes correspond- 
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ing to the different concepts of convexity that we introduced in the previous section. The 
reference book for this part is still Dacorogna [26]. 


3.1. The different envelopes 


We now define 


Cf =sup{g < f: g convex}, 

Pf =sup{g < f: g polyconvex}, 

Of =sup{g < f: g quasiconvex}, 
Rf =sup{g < f: g rank one convex}, 


they are respectively the convex, polyconvex, quasiconvex, rank one convex envelope of f. 
In view of the results of the previous section, we have 


Ch<Pf<Of<Rt<f. 


As already said, we will always assume, in the sequel, that f > 0. We then have the 
following characterizations of the different envelopes. 


THEOREM 6. Let f :RN*" + R=RU {+o}. 


Part 1. Let for any integer s 
AY 
A, = [= hn hi > 0 and Soa = i 
i=l 


then 
Nn+1 Nn+1 | 
¥ 


cre) =r} Y, 4f Gi): = DO ui, te Anat 


i=l i=1 


t+l1 t+l1 
Pye) =i Sn 6 TE)= > KT), t c Ant. 


i=l =! 
Part 2. Let Ro f = f and define inductively for i an integer, 


Risif €) = inf{tR; f (1) +  — 1) Ri f G2): t € (0, 1], & =18) +  — 1, 
rank{é, — &} = 1}, 
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then 
Rf(§)= inf Ri fG). 


THEOREM 7 (Dacorogna formula). If f :R‘*” — R is locally bounded and Borel mea- 
surable then 


1 
meas §2 


ofte)=int| [16+ dew)ar: vem (aiR")}, 


where 82 C R” is a bounded domain. In particular, the infimum is independent of the choice 
of the domain. 


REMARK 8. (i) The representation formula for Cf is standard and follows from 
Carathéodory theorem. The inductive way of representing Rf was found by Kohn and 
Strang [48]. The formulas for Pf and Qf (and a similar to that of Kohn and Strang 
for Rf) were established by Dacorogna (cf. [26]). 

(ii) Using the separation theorems one can establish other formulas for Cf and Pf, 
cf. [26]. 


3.2. Some examples 


We now discuss some examples that will be used in Section 7. We start with the following 
theorem established by Dacorogna [26] (cf. also [23] and [24]). 


THEOREM 9. 
Part 1. Let f :RN*" > R, ©: RN*" — R be quasiaffine and g:R — R be such that 
f€E)=8(@)) 


(in particular if N =n, one can take ®(&) = deté), then 


P(E) = Of (&) = Rf (§) = Ca (P(E). 
Part 2. LetN =n+1, f:RN*" > Rand g:R"t! = R be such that 


f (5) = g(adj,§), 


then 


PEE) = OF (E) = RFE) = Ca (adj,,). 
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The next result, established by Dacorogna, Pisante and Ribeiro [34], concerns functions 
depending on singular values. We let N =n and we denote by A1(&),...,A,(&) the sin- 
gular values of € € R’*” with 0 <A1(&) <--- <An(E) (which are the eigenvalues of the 
matrix (&')!/?) and by Q the set 
Q= {G34 pee RE 0 <x2< +++ < xn} 


which is the natural set, where to consider (A2(&), ..., An—1(€)) for € € R"*". 


THEOREM 10. Let g:Q0 x R>R, g=g(x,5), be a function such that x > g(x,s) is 
continuous and bounded from below for all s € R. Let f :R"*" — R be defined by 


FE) = 8(A2E),..-,An—1€), deté), 


then 


PFE) = OF (E) = RFE) = Chet §), 
where h:R — R is given by h(s) = infyeg g(x, 5). 


REMARK 11. We remark that if some dependence on A, or A, is allowed, then no simple 
and general expression for the envelopes is known; see [34], when there is dependence 
on 41, and Theorem 3.5 by Buttazzo, Dacorogna and Gangbo [12], when there is depen- 
dence on A». 


The next result concerns the Saint Venant—Kirchhoff energy function, which is par- 
ticularly important in nonlinear elasticity. The function, up to rescaling, is given by, 
v € (0, 1/2) being a parameter, 


=jeeT 2 v 2 2 
f(6) = |86" — 1) + — (le? -2) 


or in terms of the singular values, 0 << A1(&) <--- <An(E), of & € R"’*”, 


n n 2 
_ 2 4)\2 v mae 
FO=) 07-1)! += (>. >) 


i=l 


Le Dret and Raoult [49] have computed the quasiconvex envelope when n = 2 or n =3 
and they have shown the following. 


THEOREM 12. [fn =2 orn =3, then 


Of (§) =Cf(é). 
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When n = 2 it is given by 


f€) if& ¢ D U Dy, 
ChE) = PFE) =OfE)=R/E)= We 1). if & € Do, 
0 if& € Dy, 


where 


D, ={& ER: (1—v) [Ar] + [ao]? <1 and Ao(&) < 1} 
= {& €R: AE) <A2(&) <I}, 


Dy = {é eR? 1 —v) [ar] + vf]? < 1 and d2(€) > 1}. 


The last example is related to a problem of optimal design and has been studied by Kohn 
and Strang [48]. 


THEOREM 13. Letn = N=2 and 


1+|&? f& 40, 
0 if& =0. 


Then Pf = Of =Rf and 


re={ 


1+ é|? if |E|? + 2|deté| > 1, 


Of) = ae ee if JE? +2| deté| <1. 


REMARK 14. The above result is still valid when N > 3, it suffices to replace deté by 
adjpé € RO), 


3.3. The main theorem 
We now turn our attention to the relaxation theorem. We recall our minimization problem 
int{ ry = [ f (Du(x)) dx: weno + Wy" (@R") (P) 
Q 


where 1 < p< ow. 
We define the relaxed problem associated to (P) to be 


in| Te = Of (Du(x)) dx: w € uy + Wo’? (2; Rr), (QP) 
2 
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THEOREM 15 (Relaxation theorem). Let §2 Cc R” be a bounded open set. Let f: 
RN*" _. R be Borel measurable and nonnegative satisfying, for 1 < p <0, 


O< f—E)<ay(1+lé|?) foreveryé € RN*", (2) 


where a, > 0 is a constant and for p = oo it is assumed that f is locally bounded. 
Let 


Of =sup{g < f: g quasiconvex} 
be the quasiconvex envelope of f. Then 
inf(P) = inf(QP). 


CO 


More precisely, for every u € W':?(Q;RN), there exists a sequence {uP }o , Guo + 


Wo’? (2; RY) such that 


i f (Du’(x)) dx > i, Of (Du(x)) dx asv>o. 
2 Q 
REMARK 16. (i) If we add in the theorem a coercivity condition 


o(—1 +181?) < FE) <on(1 + él’), 


where a2 > 0 and p > 1, we can infer that (QP) has a minimizer and that the sequence 
{u"}°° , further satisfies 


u’—~u in wt? (2; R%) as V > 00. 


(ii) The theorem remains also valid if the function f depends on lower-order terms, 
ie., f = f(x, u, &). The quasiconvex envelope is then to be understood as the quasiconvex 
envelope only with respect to the variable &, the other variables (x, u) being kept fixed. 


PROOF OF THEOREM 15. We divide the proof into two steps. 


Step 1. We start with an approximation of the given function uw. Let ¢ > 0 be arbitrary, we 
can then find disjoint open sets 2),..., 2% C2, &,...,G&€ RNxn y independent of ¢ 
andveu+ Wy? (2; IR) such that 


meas| 2 — (yy Qi] <e, 
lwllwresllllwie Sy, (lu —vllwii <e, (3) 
D(x) =& ifx € Q). 
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By taking ¢ smaller if necessary we can also assume, using the continuity of Of and the 
growth condition on f, that 


i | Of (Du(x)) — Of (Du(x))|dx <e, (4) 


Os i _ _ [Lf (Bee) - Of (Du@))] dx <e. (5) 
2—-Uja1 2 


i 


Indeed let us discuss the case 1 < p < oo, the case p = oo being easy. As is well known 
(cf. Lemma 2.2 in [26], p. 156) any quasiconvex function is locally Lipschitz continuous 
and if it satisfies (2), then there exists 8 > O such that 


|Of (Du) — Of (Dv)| < B(1 + |Dul?~! + |Dv|?~!)| Du — Dv}. 


Using the Hélder inequality we obtain 
[ \ormw - of oo)|ax 
2 
Kp-1) (p—1)/p I/p 
<| [(1+|Dul?-! + |Dv|P—!) PP | f [bu — Du? 
Q Q 


and (4) follows therefore from (3). The inequality (5) follows from (3) and a classical 
property of the integrals (cf. Lemma 1.4 in [26], p. 19). 


Step 2. Now use Theorem 7 on every £2; to find g; € Wy” (2;; RY) 


1 
meas 2) [I Sf (& + Dgi(x)) dx 
1 
eck aees — | f (& + Doi (x) de. 
meas {2; Q; 


Setting 


1 +e) ULE RTES1 ck, 
BO eas ifxe 2-UL&, 


we get that weu+ Wy? (2; R”) and (using (5)) 


[ f (Dw(x)) — Of (Du(a)) | dx < e meas v ai] 


i=l 


inl *4i 


o<| _ Lf (Pw@)) - Qf (Duy) ] dx 
Q- Q 


i=1 °4i 


=| : | f(Dv(x)) — Of (Du(x)) | dx <e. 


i=l °4i 
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In other words, combining these inequalities, we have proved that 


0 <|[ [ f(Dw(x)) — Of (Du(x)) | dx < e(1 + meas 2). 
2 


Invoking (4), we find 


if [ f (Dw(x)) — Of (Du(x))] dx] < e(2 + meas 2). 
2 


Setting e = 1/v with v e N and u” = w, we have indeed obtained the theorem. 


We now discuss the history of this theorem (for precise references see [26]). 

In the case N =n = 1, this result has been proved by L.C. Young and then generalized 
by others to the scalar case, N = 1 or n = 1, notably by Berliochi and Lasry, Ekeland, Ioffe 
and Tihomirov and Marcellini and Sbordone. Note that in this context 


Of=cCf=f™, 


where Cf is the usual convex envelope of f. The problem (QP) can then be rewritten as 
in| 7 = i fe (Du(x)) dx: ueugt+ Wy? (2; R”) | (P**) 
Q 


The result for the vectorial case (i.e., N, > 1, recall also that, in general, we now have 
Of > Cf) was established by Dacorogna in [25]. Following a different approach it was 
later also proved by Acerbi and Fusco [1]. 

In the present context the equivalence between (QP) and (P**) is not any more valid, one 
has in general 


inf(P) = inf(QP) > inf(P**). 


The inequality is, in general, strict as in the simple example where N =n > 2 and f(€) = 
(det £)*. We indeed have 


f(§) = OF E) = (dets” and f*(E) =0. 
Therefore if det Dug > 0, then, using the Jensen inequality, we have 


inf(P) = inf(QP) 


1 2 
> meas 2 ( i: det Dug(x) ax) 
Q 


meas §2 
>0= inf(P**). 


Closely related to this approach is the notion of parametrized or Young measure, that we 
do not discuss here. 
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4. Implicit partial differential equations 
4.1. Introduction 


We now discuss the existence of solutions, u € Wi~(Q: RY ), for the Dirichlet problem 
involving differential inclusions of the form 


| Du(x)EE ae. in 92, 
u(x)=9(x), x € dX, 


where ¢ is a given function and E Cc R“*" is a given compact set. 
To relate this study with what we said in Section 1, one should imagine that 


E={& eR": OF) = fe} 


and therefore the differential inclusion is equivalent to the implicit partial differential equa- 
tion 


Of (Du(x)) = f (Du(x)) ae.xeEQ. 
In the scalar case (n = | or N = 1) a sufficient condition for solving the problem is 
Dgo(x)€EUVintcoE ae.inQ, 


where intco E stands for the interior of the convex hull of E. This fact was observed by 
several authors, with different proofs and different levels of generality; notably in [11,17, 
28,29,31,38,40]. It should be noted that this sufficient condition is also necessary, when 
properly reformulated. 

When turning to the vectorial case (n, N > 2) the problem becomes considerably harder 
and no result with such a degree of elegancy and generality is available. The first general 
results were obtained by Dacorogna and Marcellini (see the References, in particular, [31]). 
At the same time Miiller and Sverak [61] introduced the method of convex integration of 
Gromov in this framework, obtaining also similar existence results. 


4.2. The different convex hulls 


We recall the main notations that we will use throughout the present section and we refer, 
if necessary, for more details to Dacorogna and Marcellini [31]. 

Classically the convex hull of a given set E is the smallest convex set that contains E 
and it is denoted by co E. We will now do the same with the other notions of convexity 
that we have seen earlier. This is not as straightforward as it may seem and there is not a 
general agreement on the exact definitions. We will not enter in abstract considerations and 
we will use as definition of the different hulls a consequence of these abstract definitions. 
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NOTATION 17. We let, for E Cc RN*", 


Fe ={f:RY*" + R=RU {+00}: fle <0}, 


Fr={f: RN" +R: fle <0}. 


We then have respectively the convex, polyconvex, rank one convex and (closure of the) 
quasiconvex hull defined by 


cok= {ge RY*": fO@< 0 for every convex f € Fe}, 


Poco E = {é eRy". f(&) <0 for every polyconvex f € Fr}, 


Reco E = {é ZR f (&) <0 for every rank one convex f € Fat 


QcoE = {é e RX": f(€) <0 for every quasiconvex f € Fr}. 


We should point out that by replacing Fz by Fg in the definitions of co E and Pco E 
we get their closures denoted by co E and Pco E. However if we do so in the definition of 
Reco E we get a larger set than the closure of Rco E. We should also draw the attention that 
some authors call the set 


{é eR: J (&) <0 for every rank one convex f € Fr} 
the lamination convex hull, while they reserve the name of rank one convex hull to the set 
{é enix J (&) <0 for every rank one convex f € Fr}. 
We think however that our terminology is more consistent with the classical definition of 
convex hull. 


In general we have, for any set E C R“*", 


ECRcoE CPcoE ccok, 


E CRceoE CQcoE C PcoE C CoE. 


4.3. Some examples of convex hulls 


We now give several examples that will be used in the applications of Sections 6 and 7. Let 
us start with the scalar case. 


EXAMPLE 18 (Convex Hamiltonian). Let F : IR” — R be convex and let 
= {§ eR": FE) =0}, 
then 


cok = {é eR": F(é) <0}. 
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EXAMPLE 19 (Nonconvex Hamiltonian). Consider, for € € R”, the nonconvex Hamil- 
tonian 


n 
2 
F@) => [) -1] 
i=1 

and 

E={& eR": F(é)=0}, 
then 

co E =[-1,1]"”. 

We now turn to some examples in the vectorial case. The following result is due to 
Dacorogna and Tanteri (cf. [36] and also [31]), it concerns singular values. We recall that 
we denote by 0 < A1(&) <--- <An(E) the singular values of a matrix € € R’*", which are 
defined as the eigenvalues of the matrix (&')!/?. 

THEOREM 20. Let 
ESsPeR We) Ha, t=d iin}, 
where 0 < a, <--+< dy. The following equalities then hold 


coE= f eR": ya) 2G; v= hv 


i=v i=v 


n n 
Pco E = QcoE = Reo E = f eR". [[4@® <[ Ja. v= hn 
i=v i=v 


n n 
intRco E = f eR™": | aie) <[ Jai, v= hen 


i=v i=v 
where intRco E stands for the interior of the rank one convex hull of E. 


This result admits some extensions (it corresponds in the theorem below to a = —8), 
cf. Dacorogna and Tanteri [37] and Dacorogna and Ribeiro [35]. 


THEOREM 21. Leta < B, 0 < az <--- <a, be constants so that 


n 
ar] [ai > max{|cx|, |Bl}. 


i=2 
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Let 
E={& eR": deté € {a, B}, 4() =a;, 1=2,...,n}, 
then 


Pco E = QcoE = RcoE 


n n 
= {ren deté € [a, B], [[41@ <[ Ja. vad 
i=v i=v 
In particular if a = B, 
Pco E = QcoE = RcoE 
n n 
= {ren det =a, [[1@ <[ Ja. radon 
i=v i=v 


REMARK 22. It is interesting to note some formal analogy between the above result (with 
a = B£) and some classical theorems of Weyl, Horn and Thompson (see [44], [45], p. 171, 
or [53]). Their result states that if we denote, as above, the singular values of a given matrix 
EE R"*” by 0 <A, (&) <--+ <Any (S), and its eigenvalues, which are complex in general, 
by 11(&), ..-, Un(&) and if we order them by their modulus (0 < |w1(&)| <---> < |un(€))) 
then the following result holds 


Tlw@l<[]a@, v=2...0 


[Jl @|=[][a®. 
i=l i=l 


for any matrix € € R’*”. 


We will see several other examples in the next subsections. 


4.4. An existence theorem 


We start with the following definition introduced by Dacorogna and Marcellini [30] (cf. 
also [31]), which is the key condition to get existence of solutions. 


DEFINITION 23 (Relaxation property). Let E, K C R‘*". We say that K has the relax- 
ation property with respect to E if for every bounded open set 2 C R", for every affine 
function u¢ satisfying 


Dug(x) =E € K, 
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there exists a sequence uy € Af fpiec(&; RY), 
Wy €ug + Wy'(2; RY), Du,(x)€EUK ae.in®&, 


Uy ae ug in wi, / dist( Du, (x); E) dx >0 asv>o. 
2 


REMARK 24. (i) It is interesting to note that in the scalar case (n = 1 or N = 1) then 
K =intco E has the relaxation property with respect to E. 

(ii) In the vectorial case we have that if K has the relaxation property with respect to E, 
then necessarily 


K CQcoE. 


Indeed first recall that the definition of quasiconvexity implies that, for every quasiconvex 
feFfe, 


fleymeas 2 < f f (Duy (x)) dx. 
2 


Combining this last result with the fact that { Du} is uniformly bounded, the fact that any 
quasiconvex function is continuous and the last property in the definition of the relaxation 
property, we get the inclusion K C QcoE. 


The main theorem is the following one. 


THEOREM 25. Let 2 C R" be open. Let E, K C RN*" be such that E is compact and 
K is bounded. Assume that K has the relaxation property with respect to E. Let g € 
Af fpiec(2; R™) be such that 


De(x)EEUK ae.in&. 
Then there exists (a dense set of)uEg+ Wes IR”) such that 
Du(x)EE ae.inQ. 
REMARK 26. (i) According to Chapter 10 in [31], the boundary datum ¢g can be more 
general if we make the following extra hypotheses: 
e in the scalar case, if K is open, g can be even taken in W!-(2; RY), with De(x)eE 
EUK (cf. Corollary 10.11 in [31]); _ 
e in the vectorial case, if the set K is open, g can be taken in Cie (2; RY) (cf. Corol- 


lary 10.15 or Theorem 10.16 in [31]), with De(x) € EU K. While if K is open and 
convex, ¢ can be taken in w!(@2; RY) provided 


De(x)EC ae.in’, 


where C Cc K is compact (cf. Corollary 10.21 in [31]). 
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(ii) In the scalar case (cf. Theorem 29) the hypothesis on the compactness of FE can be 
dropped. 

(iii) This theorem was first proved by Dacorogna and Marcellini [30] (cf. also Theo- 
rem 6.3 in [31]) under the further hypothesis that 


BS/EeR Ys BE) H0n8 = 152, coos, 


where F;:RV*" > R,i=1,2,...,/, are quasiconvex. This hypothesis was later removed 
by Sychev [74] using the theory of convex integration (see also Miiller and Sychev [63]). 
Kirchheim in [46] pointed out that using a classical result (Theorem 38) then the proof of 
Dacorogna and Marcellini was still valid without the extra hypothesis on EF. Kirchheim’s 
idea, combined with the proof of [31], was then used by Dacorogna and Pisante [33] and 


we will follow this last approach. 
PROOF OF THEOREM 25. We let V be the closure in L®(Q; RY) of 
V = {ue Af fpice(Q; R™): u=¢y on AQ and Du(x) € EU K}. 


V is nonempty since g € V. Let, fork EN, 


= 1 
vk = int u eV: / dist(Du(x); E) dx < cf 
2 


where the “int” stands for the interior of the set. We claim that ye, in addition to be open, 
is dense in the complete metric space V. Postponing the proof of the last fact for the end 
of the proof, we conclude by Baire category theorem that 


V‘ c{weV: dist(Du(x), Z)=Oae.in2Q}CcV 


_)8 


> 
Il 


1 
is dense, and hence nonempty, in V. The result then follows since E is compact. 
We now show that V* is dense in V. So let u € V and ¢ > 0 be arbitrary. We wish to 
find v € V* so that 
Iu — ln <é. 


We recall (cf. Section 4.6) that 


@p(a) = lim sup |Du — Dwl|lri(a), 
80 y WE Boo (a,8) 


where 


Boo(a, 6) = {ue V: |lu—allz~ <5}. 
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e We start by finding a € V, a point of continuity of the operator D, so that 
lu —allux <= 
u-—allpo <n. 
ae 
This is always possible by virtue of Corollary 40. In particular, we have that the os- 


cillation wp(a) of the gradient operator at a is zero. 
We next approximate a € V by f € V so that 


€ 1 

- o Sx d —. 

IB—ellze <3 and wp(B) <5, 
This is possible since, by Proposition 37, we know that for every ¢ > 0 the set 

Qh = {u EV: wp(u) < e} 

is open in V. 

e Finally we use the relaxation property on every piece where Df is constant and we 
then construct v € V, by patching all the pieces together, such that 


1 1 
|B —vil~~ < @p(v)<— and / dist(Dv(x); E) dx < Ee 
Q 


é 
3° 2k 
Moreover, since wp(v) < aE we can find 6 = 6(k, v) > 0 so that 


1 
lu-—vllze <5 => ||Dv— Dlr < Ok 


and hence, 
1 
/ dist(Dy (x); E) dx <| dist(Du(x); E) dx + ||Du — Dyllz1 < k 
Q 2 


for every  € Boo(v, 5); which implies that v € V*. 
Combining these three facts we have indeed obtained the desired density result. 


To conclude this subsection we give a sufficient condition that ensures the relaxation 
property. In concrete examples this condition is usually much easier to check than the 
relaxation property. We start with a definition. 


DEFINITION 27 (Approximation property). Let E C K(E) C R%*”. The sets E and 
KE) are said to have the approximation property if there exists a family of closed sets Es 
and K(E3), 6 > 0, such that 

(1) Es C K(E3) C int K (E) for every 6 > 0; 

(2) for every ¢ > 0 there exists 59 = do9(€) > 0 such that dist(n; E) < e for every n € Es 
and 6 € [0, do]; 
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(3) if 7 € int K(£), then n € K(E;3) for every 5 > 0 sufficiently small. 


We therefore have the following theorem (cf. Theorem 6.14 in [31], and for a slightly 
more flexible one see Theorem 6.15). 


THEOREM 28. Let E C R*" be compact and Reo E has the approximation property 

with K (Es) = Rco Ej, then intRco E has the relaxation property with respect to E. 

4.5. Some examples of existence of solutions 

We now give several examples of existence theorems that follow from the abstract ones. 
The first one concerns the scalar case, where we can even get sharper results (cf. [11,17, 

28,29,31,38,40]). 

THEOREM 29. Let 2 CR" be a bounded open set and E CR". Let g € W!®(Q) satisfy 


Deo(x)EEUintcoE aeexEQ (6) 


(where intco E stands for the interior of the convex hull of E), then there exists u € g + 
Wy (22) such that 


Du(Xx)EE aexeM. (7) 


REMARK 30. The theorem is in fact much less restrictive than the abstract one, here 
we do not need, for example, E to be compact. For a proof we refer to Dacorogna and 
Marcellini [31]. 


We now show that (6) is in fact also a necessary condition, at least when ¢ is affine, 
for the general case see Section 2.4 in [31]. For the affine case the result is implicit in the 
above-mentioned articles, but we follow here Bandyopadhyay, Barroso, Dacorogna and 
Matias [9]. 


THEOREM 31. Let 82 C R" be a bounded open set, E C R", & € R" and u € ug, + 
Wy’ (2) (ug, being such that Dug, = 0) so that 


Du(ix)EE aexeQ, 
then 
&) € E Uintco LE. 


PROOF. Assume that &) ¢ E, otherwise nothing is to be proved. It is easy to see that, by 
the Jensen inequality and since Du(x) € E, 


1 
mea 


/ Du(x)dx € COE. 
s 92 Q 
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Let us show that we cannot have 9 € 0(coE). If we can prove this, we will deduce that 
&) € intcoF. Since intcoE = intco E (cf. Theorem 6.3 in Rockafellar [71]), we will have 
the result. 

If & € (COE), we find from the separation theorem that there exists a € R”, a £0, 
such that 

(a;z—&)>0 VWzeEcoE. 

We therefore have that 


(a; Du(x) — &)>0 ae.xe. 


Recalling that u € ug, + Wy’ (2), we find that 


i (a; Du(x) — &)dx =0 
Q 
which coupled with the above inequality leads to 
(a; Du(x) — &)=0 ae.xe. 
Applying Lemma 57, we get that u = ug, and hence & € E, a contradiction with the 


hypothesis made at the beginning of the proof. Therefore &) ¢ 0(COE) as claimed and 
hence the theorem is proved. 


Theorem 29 applies to the following case. 


COROLLARY 32 (Convex Hamiltonian). Let 2 C R” be a bounded open set and F: 
IR” — R be convex and such that limyg|-+o9 F (€) = +00. Let g € W!:°°(Q) be such that 


F(Dg(x)) <0 aexEeQ. 


Then there exists u€E yo + Wai G2) such that 
F(Du(x)) =0 aexes. 


The next one deals with the singular values case that we have encountered in Section 4.3. 
The next theorem is due to Dacorogna and Ribeiro [35]. 


THEOREM 33 (Singular values). Let 2 C R” be a bounded open set, a < B and 0 < 
a2 <+++ <ady be such that 


max {|q|, |B|} }<e[ To 
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Letg eC! 


piec 


(2; IR") be such that, for almost every x € Q, 
n n 
a < det Dy(x) < B, | [i (Pe@) <a. v=2,...,Nn. 
i=v i=v 
Then there exists ue g+ Wy? (2; R") so that, for almost every x € Q, 
det Du(x) € {a, B}, Ke (DuG)) Say; V= 2.057: 


REMARK 34. (i) If a= —f <0 and if we set 


we recover the result of Dacorogna and Marcellini [31], namely that if 


n 


n 
| [4 (Pee) < | Ja. etal eae 
i=v i=v 
then there exists u€ g + Wy? (2; IR”) so that 


Ay(Du)=ay,, v= l,...,n, ae.in 22. 


(ii) If 7 = 6 £0 we can also prove, as in Dacorogna and Tanteri [37], that if 


n 
det Dy(x) =a, ] [Ai(Pe@) <| fa. v=2,...,n, 


i=v 1=v 
then there exists u€ g + Wy (2; R”) so that 


Ay(Du)=ay, v=2,...,n, and detDu=a ae.in&2. 


4.6. Appendix 


In this appendix we recall some well-known facts about the so-called functions of first class 
in the sense of Baire, with particular interest in their application to the gradient operator. 
We start recalling some definitions. 


DEFINITION 35. Let X, Y be metric spaces and f : X — Y. We define the oscillation of f 
at x9 € X as 


wr(xo)=lim sup —dy(f(y), f(x), 
80 x yeBy (x0,5) 
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where By (xo, 6) := {x € X: dx (x, x0) < 5} is the open ball centered at x9 and dy, dy are 
the metric on the spaces X and Y, respectively. 


DEFINITION 36. A function f is said to be of first class (in the sense of Baire) if it can 
be represented as the pointwise limit of an everywhere convergent sequence of continuous 
functions. 


In the next proposition we recall some elementary properties of the oscillation func- 
tion wf. 


PROPOSITION 37. Let X, Y be metric spaces, and f :X — Y. 
(i) f is continuous at xq € X if and only if w¢ (xo) = 0. 
(ii) The set 2 r= {x © X: wz (x) < €} is an open set in X. 


Using the notion of oscillation and Proposition 37 we can write the set D of all points 
at which a given function f is discontinuous as an F, set as follows 


ee) 


p= rex: ops) >I. (8) 


n=1 


We therefore have the following Baire theorem for functions of first class (for a proof 
see Theorem 7.3 in Oxtoby [65], Yosida [79], p. 12, or Dacorogna and Pisante [33]). 


THEOREM 38. Let X, Y be metric spaces let X be complete and f:X — Y. If f is 
a function of first class, then D f is a set of first category. 


REMARK 39. From Theorem 38 and the Baire category theorem follows in particular that 
the set of points of continuity of a function of first class from a complete metric space X to 
any metric space Y, i.e., the set DY complement of Dy, is a dense G3 set. Indeed for any 
€ > O, the set 


Ry — {x eX: wf(x) < e} 
is open and dense in X. 


In the proof of our main theorem we have used Theorem 38 applied to the follow- 
ing, quite surprising, special case of function of first class. This result was observed by 
Kirchheim [46] for complete sets of Lipschitz functions and the same argument gives in 
fact the result for general complete subsets W!:°°(2) functions. 


COROLLARY 40. Let 2 C R" be a bounded open set and let VC W'!™(Q) be a 
nonempty complete space with respect to the L® metric. Then the gradient operator 
D:V —> L?(Q; R") is a function of first class for any 1 < p < 0. 
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PROOF. For h 40, we let 
D" =(Df,..., Dt): V > L?(2;R") 
be defined, for every u € V and x € 22, by 


he;)— ee 
Hee uGrhe—uG) if dist(x, 2°) > lhl, 
L 

elsewhere, 


fori=1,...,n, where e;,..., e, stand for the vectors from the Euclidean basis. 
The claim will follow once we will have proved that for any fixed / the operator D” is 
continuous and that, for any sequence h > 0, 


: h 
lim | Dp u— Dju| Lp(a) = 9 
foranyi=1,...,.n,ueEV. 
The continuity of D” follows easily by observing that for every i= 1,...,n, ¢ > 0 and 


u,v € V we have that 


| Diu _ De aces 


1 1/p 
<a ae |u(x) — v(x) + u(x + hej) — ve + hes|? dr) 


2(meas 2)!/? 
7 |h| 


lu — vl t~(2), 


where 82; = {x € 2: dist(x, 2°) > |h|}. 
For the second claim we start observing that, for any x € §2;, and for any u € V, we have 


|u(x + he;) — u(x)| < ||Djullz~(ay|Al- 
This implies that 
| Dh pay < IDiullamcay < +00. 
Moreover, by Rademacher theorem, for any sequence h —> 0, 


lim Dj'u(x) = Dju(x) ae.xeEQ. 


The result follows by Lebesgue dominated convergence theorem. 
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5. Existence of minimizers 
5.1. Introduction 


We now discuss the existence of minimizers for the problem 
int{ [ f (Du(x)) dx: u € ug, + Wy (2: Rr”), (P) 
Q 


where 2 C R” is a bounded open set with Lipschitz boundary, u:2 — RY, f: 
IR‘*” _, R is lower semicontinuous, locally bounded and nonnegative and Ug, 1S a given 
affine map (1.e., Dug, = 0, where & € R** is a fixed matrix). 

If the function f is quasiconvex, i.e., 


i f(E + De(x)) dx > f(E) meas(U) 


for every bounded domain U C R”, € € RN*” and ge Wy; IR"), then the prob- 
lem (P) trivially has ug) as a minimizer. We also recall that in the scalar case (n = 1 or 
N = 1), quasiconvexity and ordinary convexity are equivalent. 

We now study the case where f fails to be quasiconvex. The first step in dealing with 
such problems is the relaxation theorem (cf. Theorem 15). It has as a direct consequence 
(cf. Theorem 41) that (P) has a solution u € ug) + Ww,” (Q; RY) if and only if 


f (Dii(x)) = Of (Dii(x)) aexe 2, 
[ Of (Dii(x)) dx = Of (Eo) meas Q, 


where Qf is the quasiconvex envelope of f, namely 


Of =sup{g < f: g quasiconvex}. 


The problem is then to discuss the existence or nonexistence of a u satisfying the two 
equations. The two equations are not really of the same nature. The first one is what we 
called in Section 4 an implicit partial differential equation. The second one is more geo- 
metric in nature and has to do with some “quasiaffinity” of the quasiconvex envelope Qf. 

In the present section we will discuss some abstract necessary and sufficient conditions 
for the existence of minimizers for (P) and in Sections 6 and 7 we will see several examples. 
We will follow in the present section the approach of Dacorogna, Pisante and Ribeiro [34]. 


5.2. Sufficient conditions 


With the help of the relaxation theorem and of Theorem 25, we are now in a position to 
discuss some existence results for the problem (P). The following theorem (cf. [27]) is 
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elementary and gives a necessary and sufficient condition for existence of minima. It will 
be crucial in several of our arguments. 


THEOREM 41. Let Q, f and ug, be as above, in particular, Dug, = &. The problem (P) 
has a solution if and only if there exists u € Ug, + We: RY) such that 


f (Dii(x)) = Of (Di(x)) ae.x EQ, (9) 
[ Of (Dii(x)) dx = Of (0) meas £2. (10) 
PROOF. By the relaxation theorem and since ug, is affine, we have 
inf(P) = inf(QP) = Of (&) meas 2. 
Moreover, since we always have f > Of and we have a solution of (9) satisfying (10), we 


get that w is a solution of (P). The fact that (9) and (10) are necessary for the existence of 
a minimum for (P) follows in the same way. 


The previous theorem explains why the set 


K ={€ eR**": OF) < f®)} 


plays a central role in the existence theorems that follow. In order to ensure (9) we will 
have to consider differential inclusions of the form studied in the previous section, namely: 
find i € ug) + Wy’ (2; R") such that 


Du(x)EdK ae.xEeQ. 


In order to deal with the second condition (10) we will have to impose some hypotheses of 
the type “Of is quasiaffine on K”’. 
The main abstract theorem is the following one. 


THEOREM 42. Let 2 C R" be a bounded open set, & € RN*", f :RN*" > R, a lower 
semicontinuous, locally bounded and nonnegative function and let 


K ={neR*": Of(n) < fi}. 


Assume that there exists Kg C K such that 
e &) € Ko, 
e Ko is bounded and has the relaxation property with respect to Ky 18K, 
e Of is quasiaffine on Ko. 

Let ug) (x) = 0x. Then the problem 


int{ ray = [ f (Du(x)) dx: Wey + Wo™(2iR")| (P) 
2 
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has a solution u € ug + Wy? (Q; RY). 
REMARK 43. (i) Although this theorem applies only to functions f that takes only finite 


values, it can sometimes be extended to functions f :R‘*” > R=RU {+00}. 
(ii) The last hypothesis in the theorem means that 


i. Of (§ + Dg(x)) dx = Of (€) meas 2 


for every & € Ko, every 9 € Wy? (2; RY) with 

€+Dy(x)€Ko ae.in®. 
PROOF OF THEOREM 41. Since & € Kg and Kg is bounded and has the relaxation 
property with respect to Kg 1 0K, we can find, appealing to Theorem 25, a map u € 
Ug, + Wy (2; RY) satisfying 


Die KoNdK ae.ing, 


which means that (9) of Theorem 41 is satisfied. Moreover, since Qf is quasiaffine on Ko, 
we have that (10) of Theorem 41 holds and thus the claim. 


The second hypothesis in the theorem is clearly the most difficult to verify, nevertheless 
there are some cases when it is automatically satisfied. For example, if K is bounded, we 
can take Kop = K. 

We will see that, in many applications, the set K turns out to be unbounded and in order 
to apply Theorem 42 we need to find some weaker conditions on K that guarantees the 
existence of a subset Ko of K satisfying the requested properties. With this aim in mind 
we give the following notation and definition. 


NOTATION 44. Let K C R*” be open and A € RN*", 

(i) For € € K, we denote by Lx (&, A) the largest segment of the form [§ + ta,&+ sd], 
t<O<s, sothat (€+1fA,E +s) CK. 

(ii) If Lx(é,4) is bounded, we denote by t_(€) < 0 < t,(&) the elements so that 
Lx(é,4) =[& +t_A,& + tA]. They therefore satisfy 


E+t,A€dK and €+trAeK Vee (t_,t,). 


(iii) If H C K, we let 


Lx(H,) = (J Led. 


EcH 


DEFINITION 45. Let K C R*” be open, & € K anda € RY*". 
(i) We say that K is bounded at & in the direction X if LK (&, 4) is bounded. 
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(ii) We say that K is stably bounded at & in the rank-one direction = a ® B (with 
a € RX and B € R”) if there exists e > 0 so that Lx (&) +a ® Be, A) is bounded, where 
we have denoted by 


Eo +a @ Be={— ¢RN*": & =f +a @b with |b| <e}. 


Clearly a bounded open set K is bounded at every point € € K and in any direction A 
and consequently it is also stably bounded. 

We now give an example of a globally unbounded set which is bounded in certain direc- 
tions. 


EXAMPLE 46. Let N =n =2 and 
K={é € R°**: w <deté < B}. 


The set K is clearly unbounded. 
(i) If & = J then K is bounded, and even stably bounded, at &, in a direction of rank 
one, for example, with 


1 0 0 0 
r= (4 0) or r= () a 


(ii) However if & =0, then K is unbounded in any rank one direction, but is bounded 
in any rank two direction. 


In the following result we deal with sets K that are bounded in a rank-one direction 
only. This corollary says, roughly speaking, that if K is bounded at & in a rank-one direc- 
tion 4 and this boundedness (in the same direction) is preserved under small perturbations 
of &) along rank one A-compatible directions, then we can ensure the relaxation property 
required in the main existence theorem. 


COROLLARY 47. Let 2 CR" be a bounded open set, f :RN*" — Ra lower semicontin- 
uous function, locally bounded and nonnegative and let &) € K, where 


K ={é eR*": Of < f®}. 


If there exist a rank-one direction  € RN*" such that 
(i) K is stably bounded at & in the directionh =a ® B, ro 
(i) Of is quasiaffine on the set (cf. Definition 45) Lx (9 +a ® Bg, i), then the problem 


int{ ry =f f (Du(x)) dx: Wey + Wo™(2ER)| (P) 
Q 


has a solution u € Ug + Wy? (2; RY). 
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PROOF. We divide the proof into two steps. 


Step 1. Assume that |8| = 1, otherwise replace it by 6/|f|, and let 6, € R”, k >n, with 
|Bx| = 1, be such that 


0 € H := intco{B, —8, B3,..., Bx} C Bi) = {x ER": |x| <1}. 
Let then, for ¢ > 0 as in the hypothesis, 
Ko := (&0 +a @ eH) U [aK NL (+a @eH,A)]. 
We therefore have that &) € Ko and, by hypothesis, that Ko is bounded, since 
Ko C Ko CL x (fo +a @ Be, A). 
Furthermore we have 
Ky 0K =9K OL x (f) +a @eH,A). 


In order to deduce the corollary from Theorem 42, we only need to show that Ko has the 
relaxation property with respect to Ko 1 0K. This will be achieved in the next step. 


Step 2. We now prove that Ko has the relaxation property with respect to Ky NOK. Let 
€ € Ko and let us find a sequence uy € Af fpiec (2; RY) so that 


Wy €ue + Wy (2:RX), — Duy(x) € (KoNOK)UKo ae.ing, 

(11) 

Uy ae ug in wi, / dist(Duy (x); Kon dK) dx->0 asv>o. 
2 


IfFéecoKNLe(&+a® eH,)d), nothing is to be proved; so we assume that € € &) + 
a ® €H. By hypothesis (i), we can find t_ (€) < 0 < t(&) so that 


&p:=E+t.AcCdK and €+tAeK VteE(t_,ty) 


and hence 4 € Ko 8K. We moreover have that 


—t ty 


7 + 
t.—t 4 t—t 


é é with & ¢ KoN dK. (12) 


Furthermore, since € € &) + a ®@ €H, we can find y € €H such that 
F=f tay. 


The set H being open we have that Bs(y) C ¢H, for every sufficiently small 6 > 0. More- 
over, since for every 6 > 0, we have 


0 € 8H = intco{+é£, 5f3,..., Bx} 
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and since for every sufficiently small 5 > 0, we have 


+668 € co{+(ty = t_)B} Cc cof{#(ty — t_)B, 6B3,..., 5Px}, 


we get that 


0 € 5H = intco{+dB, 5B3, ..., 58x} C intco{+(t, — t_)B, 683, ..., Bx}. 


We are therefore in a position to apply Lemma 48 to 
a=a, b= (te —t_)B, bj =6B; for j =3,...,k, t= ——_, 
. fae 


ty 
tye —t 


A=E,=E+ a @ (ty —t_)B=E+(1—Na@b, 


; a® (ty —t_)B=E-ta@b, 


and find us € Af foiec (2; RY), open sets £24, 2Q- C £2, such that 


|meas(2,. UR_) — meas 2| <6, 

us(x) =ug(x), x E92, and |us(x)—ug(x)| <8, xe Q, 
Dus(x)=é4 ae.in 24, 
Dus(x) € € + {tra @ B, t_a ® B,a @ d83,...,a@ 56h} ae.inQ. 


(13) 


Since £4 € Ky NOK and 


E+a®6pj €€ +a @dH =H+a@(y+5H) 
Céip9+a®eHC Ko for j =3,...,k, 


we deduce, by choosing 6 = 1/v as v > ow, from (13), the relaxation property (12). This 
achieves the proof of Step 2 and thus of the corollary. 


We finally want to point out that, as a particular case of Corollary 47, we find the exis- 
tence theorem (Theorem 3.1) proved by Dacorogna and Marcellini [27]. 

We have used the following result due to Miiller and Sychev [63] and which is a refine- 
ment of a classical result. 


LEMMA 48 (Approximation lemma). Let §2 C R” be a bounded open set. Let t € [0, 1] 
and A, B € RN*®" such that 


A-—-B=a®b 
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with a € RN and b € R". Let b3,..., be € R", k =n, such that 0 € intco{b, —b, b3, 
..., by}. Let g be an affine map such that 


Do(x) =& =tA+(1—-1t)B, xEQ 


(i.e. A=é&+ (CU —t)a @b and B= & — ta @ b). Then, for every ¢ > 0, there exists a 
piecewise affine map u and there exist disjoint open sets 2,4, S23 C Q, such that 


| meas {24 — t meas 2], meas 2, — (1 — t)meas Q| <e, 
u(x)=9(x), x€I92, and |u(x)—g(x)|<e, xEQ, 
A inQa, 

BinQp, 


Du(x) € + {U1 —1)a @b, -1a@b,a@b3,...,a@by} ae.in&. 


Du(x) = 


5.3. Necessary conditions 


Recall that we are considering the minimization problem 
int{ Fa) = f (Du(x)) dic: u € ug + Wy’ (@; Rr”), (P) 
Q 


where {2 is a bounded open set of IR”, ug, is affine, i.e., Dug, = & and Frees" — Ris 
a lower semicontinuous, locally bounded and nonnegative function. In order to avoid the 
trivial case we will always assume that 


Of (0) < f (0). 


Most nonexistence results for problem (P) follow by showing that the relaxed prob- 
lem (QP) has a unique solution, namely ug,, which is by hypothesis not a solution of (P). 
This approach was strongly used in Marcellini [51], Dacorogna and Marcellini [27] and 
Dacorogna and Pisante [34]; we will follow here [34]. We should point out that we will 
give an example (see Proposition 78 in Section 7.5) related to minimal surfaces, where 
nonexistence occurs, while the relaxed problem has infinitely many solutions, none of them 
being a solution of (P). 

The right notion in order to have uniqueness of the relaxed problem is the following 
definition. 


DEFINITION 49. A quasiconvex function f :R*" — R is said to be strictly quasiconvex 
at &) € R"*", if for some bounded domain U C R” the following equality holds 


[ f (& + De(x)) dx = f (>) meas(U) 


for some @ € Wy U; IR), then necessarily g = 0. 
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We should observe that as in Remark 5(v) the notion of strict quasiconvexity is indepen- 
dent of the choice of the domain U, more precisely we have the following proposition. 


PROPOSITION 50. If a function f :IRN*" — R is strictly quasiconvex at & € RN*" for 
one bounded domain U C R" it is so for any such domain. 


PROOF. Let V C R” be a bounded domain and w € Wyo (V; IR”) be such that 


i, Ff (& + D(x) dx = f (Go) meas(V) (14) 


and let us conclude that we necessarily have w = 0. 
Choose first a > 0 sufficiently large so that 


4 Cc Qa = (-a, a)" 
and then define 


wx) ifxeV, 


vy=|P ifx€ Oo—-V, 


so that v € Wy’ (Qa: RY). 
Let then xo € U and choose v sufficiently large so that 


1 aa\" 
Xo + -Qag=x0+ | --.- CU. 
v vv 


Define next 


Ly(v(w—x0)) ifx exo+}Qa, 
g(x) = : i 
ifxeU — [x0 + ~ Qa. 


Observe that g € Wy; IR) and 
[0+ Deeo)ax 


1 
= FGoymeas(U i E + 24) +f f (& + Do(vx a xo))) dx 
¥ [vot 4 Qa] 


a 1 
=r ee [meas ee J 7 ) f (& + Dv(y)) dy 
= f Go) [meas(v) aioe 4, ee: = 2) 


1 
+= [Fle + Dvo)ay. 
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Appealing to (14), we deduce that 
a f (& + De(x)) dx = f (Go) meas(U). 


Since f is strictly quasiconvex at & € R“*” for the domain U, we deduce that y = 0, 
which in turn implies that 


v(y) =0_ forevery y € Qa. 


This finally implies that w = 0 as claimed. 


We will see further some sufficient conditions that can ensure strict quasiconvexity, but 
let us start with the elementary following nonexistence theorem. 


THEOREM 51. Let f:IRY*”" — R be lower semicontinuous, locally bounded and non- 
negative, & € RN*" with Of (0) < f (0) and Of be strictly quasiconvex at &). Then the 
relaxed problem (QP) has a unique solution, namely ug), while (P) has no solution. 


PROOF. The fact that (QP) has only one solution follows by definition of the strict quasi- 
convexity of Qf and Proposition 50. Assume for the sake of contradiction that (P) has 
a solution u € Ug, + Wy (2: IR"). We should have from Theorem 41 that (writing 
U(x) = ox + (x)) 


f (0 + De(x)) = Of (&+ Dy(x)) ae.xeQ, 


ih Of (& + Do(x)) dx = Of (9) meas 22. 


Since Qf is strictly quasiconvex at &), we deduce from the last identity that p = 0. Hence 
we have, from the first identity, that Of (&)) = f(&), which is in contradiction with the 
hypothesis. 


We now want to give some criteria that can ensure the strict quasiconvexity of a given 
function. The first one has been introduced by Dacorogna and Marcellini [27]. 


DEFINITION 52. A convex function f :R‘*” — R is said to be strictly convex at & € 


R*" in at least N directions if there exists a = (a')!S'S“ € RN*", a! £0, for every 
i=1,..., N, such that: if for some n € RY" the identity 


1 1 1 
5 Fo +n)+ 5 Fo) = #(& + 5) 


holds, then necessarily 


(a'; n'\=0, i=l,...,N. 
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In order to understand better the generalization of this notion to polyconvex functions 
(cf. Proposition 58), it might be enlightening to state the definition in the following way. 


PROPOSITION 53. Let f :IR‘*" — R be a convex function and, for & € RN*", denote 
by Of (&) the subdifferential of f at &. The two following conditions are then equivalent: 
(i) f is strictly convex at & € RN ** in at least N directions, 
(ii) there exists a = (a')!S!SN € RN*" with a! #0 for every i =1,...,N, so that 
whenever 
f(&o +m) — f(&o) — (Asn) =0 
for some n € RN*" and for some i € af (Ey), then 
(a'; n') =0, i=1,...,N. 


PROOF. 


Step 1. We start with a preliminary observation that if 


1 1 1 

5fé0+m +5406) = 5 (ko 5") (15) 
then, for every t € [0, 1], we have 

tf(&o +n + —2) fo) = f (Eo + tn). (16) 


Let us show this under the assumption that t > 1/2 (the case t < 1/2 is handled similarly). 
We can therefore find a € (0, 1) such that 


1 
ee ee 


From the convexity of f and by hypothesis, we obtain 


1 1 1 
7 Fo +) + 5 F G0) = (f+ 5") <af(§ + tn) + 1 — a) f (0). 


Assume, for the sake of contradiction, that 


f(&o + tn) < tf (Eo +n) + Ud — 1) f Eo). 


Combine then this inequality with the previous one to get 


1 1 
5 FGo+n) + 5 FE) < a[tf (Go +n) + (1-1) f Go) ] + Ud — «) f Go) 


1 


1 
= sf Got n) + 5 fo) 
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which is clearly a contradiction. Therefore the convexity of f and the above contradiction 
implies (16). This also implies that 


fo + tn) — f Eo) 
t 


f'(.n) = lim = f(Eo +n) — f (&0). 
t>0t 


Applying Theorem 23.4 in Rockafellar [71], combined with the fact that df (&)) is non- 
empty and compact, we get that there exists 4 € df (&) so that f (& +) — f(&) = (A; n) 
and hence 


fo + tn) — fo) — t(Asn) =O We [0, 1]. (17) 


We have therefore proved that (15) implies (17). Since the converse is obviously true, 
we conclude that they are equivalent. 


Step 2. Let us show the equivalence of the two conditions. 
(i) = (ii). We first observe that for any « € R“*" we have 


1 1 1 
7 Fo +n) + 5 F Go) a (a + 5) 


1 


1 1 
= 5 LS Go +n) — f &0) — (us n)] EGS 5) — fo) — Pil n)} 


(18) 
Assume that, for 2 € df (0), we have 


fo +) — f (Eo) — (A; n) =0. 


From (18) applied to uw = A, from the definition of df (>) and from the convexity of f, we 
have 


1 1 1 
O< 5 ftéo+) + 51) — F( +59) 
1 1 
= -|#(%+ 5) — fo) — 5 Ai n| <0. 


Using the above identity, we then are in the framework of (i) and we deduce that (a; 
n') =0,i=1,..., N, and thus (ii). 
(ii) => G). Assume now that we have (15), namely 


1 1 1 
= ae - =n) =0, 
5 fo +m + 5 Fo) (+5) 
which, by Step 1, implies that there exists 4 € df (&) so that 


f(&o + tn) — fo) — tas) =0 Vee [0, 1]. 
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We are therefore, choosing t = 1, in the framework of (ii) and we get (a; n') =0,i= 
1,..., N, as wished. 


Of course any strictly convex function is strictly convex in at least N directions, but 
the above condition is much weaker. For example, in the scalar case, N = 1, it is enough 
that the function is not affine in a neighborhood of &, to guarantee the condition (see 
Corollary 55). 

We now have the following result established by Dacorogna and Marcellini [27]. 


PROPOSITION 54. If a convex function f :R*" — R is strictly convex at & € RN*" in 
at least N directions, then it is strictly quasiconvex at &0. 


Theorem 51, combined with the above proposition, gives immediately a sharp result for 
the scalar case, namely the following corollary. 


COROLLARY 55. Let f :R” — R be lower semicontinuous, locally bounded and nonneg- 
ative, &) € R” with Cf (0) < f(&) and Cf not affine in the neighborhood of &). Then 
(P) has no solution. 


REMARK 56. In the scalar case this result has been obtained by several authors, in par- 
ticular, by Cellina [16], Friesecke [40] and Dacorogna and Marcellini [27]. It also gives 
(cf. Theorem 66), combined with the result of the preceding section, that, provided some 
appropriate boundedness is assumed, a necessary and sufficient condition for existence of 
minima for (P) is that f be affine on the connected component of {&: Cf(€) < f(&)} that 
contains &o. 


Before proceeding with the proof of Proposition 54 we need the following elementary 
lemma. 


LEMMA 57. Let 2 be a bounded open set of R" and 9 € Wy? (2; RY) be such that 
(a; Dg’ (x)) =0 ae.x€2,i=1,...,N, 
for some a' £0, i =1,...,N, theny =0. 


PROOF. Working component by component we can assume that N = | and therefore we 
will drop the indices. So let g € Wy’ (2) satisfy for some a € R", a £0, 


(a; Dg(x)) =0 aexeQ. 


We then choose a2,...,@n, € R” so that {a, a2,...,@,} generate a basis of R”. Let a > 0 
and for m an integer, 


Q”’ = (—a,a)”. 
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Let x € 2 and let a and ¢ be sufficiently small so that 


X+TH+ T2072 +--+ + Try € 2 


for every t € (0, t) and (t%,...,T) € Oe 


Observe then that if g € Ci (£2), then 
[lect tart toca +++ tytn) = 9+ tran +++ tytn] dea ++ dey 
Qa” 
id 
-| / —[o(x + ta + T1202 + +++ + TrOn)| dt dry --- dt 
on} 0 dt 
t 
=i. .) (De(x + Ta + T2a2 +++++ Tran); «) dt dtz +++ dt. 
Or 40 


By a standard regularization procedure the above identity also holds for any g € Wy ORD): 
Since (a; Dg) = 0, we deduce that 


i- [p(x + tot + T2942 + +++ + TrQn) 
— V(x + 1202 + +++ + TO) ] dt? --- dt, =0. 


Since ¢ is continuous, we deduce, by dividing by the measure of oO and letting a > 0, 
that, for every ¢ sufficiently small so that x + ta € Q, 


p(x + ta) = g(x). 
Choosing f so that 
x+tae2 Vre[0,t) and x+taedl, 


we obtain the claim, namely 


g(x)=0 Vee. 


PROOF OF PROPOSITION 54. Assume that, for a certain bounded domain U C R” and for 
some gy € Wy; R), we have 


1, f ( + De(x)) dx = f (&) meas(U) 


and let us show that g = 0. 
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Since f is convex and the above identity holds, we find 


1 1 
f (&) meas(U) = [ Ex + 5f(S+ a) dx 


1 
>| f(s0-+ ;Dex)) as 
U 


2 f (§o)meas(U), 
which implies that 
1 1 1 
/ Ex - 5F 0 + Dg(x)) — r(& az ;Potx)) dx = 0. 
U 

The convexity of f implies then that, for almost every x in U, we have 

1 1 1 

7 F Go) + 5/ (&0 + Dg(x)) — iG + = Dotx)) =0. 


The strict convexity in at least N directions leads to 


(a‘; Dg! (x)) =0 ae.x€2,i=1,...,N. 


Lemma 57 gives the claim. 


We will now generalize Proposition 54. Since the notations in the next result are in- 
volved, we will first write the proposition when N =n =2. 


PROPOSITION 58. Let f :R‘*" — R be polyconvex, & € RN *" and i = A(Ep) € RT” 
so that 


f & +n) — f 0) — (A; To +n) — T(&o)) > 0 for every n€ Roe 


(i) Let N=n=2 and assume that there exist ot! gl? gy? © R% gl 40, a2? #0, 
BER, so that if for some n € R°*? the following equality holds 


f(& +n) — f 0) — (As T (Eo +n) — TE) = 0, 
then necessarily 
(a; n°) =0 and teres n') + la n°) + Bdetn =0. 


Then f is strictly quasiconvex at &. 
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(ii) Let N,n > 2 and assume that there exist, for every v=1,..., N, 


a ghttl oo gtN eRn a” £0, 


BERD, 2<5<na(N—-v4])), 
so that if for some n € RN*" the following equality holds 


f (& +n) — f 0) — (As T(E + 0) — T &o)) =0, 


then necessarily 


N nA(N—v+1) 
Solera So che adh Gas 0 Cada 
S=v s=2 


Then f is strictly quasiconvex at &. 
REMARK 59. (i) The existence of a A as in the hypotheses of the proposition is automati- 
cally guaranteed by the polyconvexity of f (see (1) in Section 2, it corresponds in the case 


of a convex function to an element of df (&)). 
(ii) We have adopted the convention that if / > k > 0 are integers, then 


k 
=o. 
1 
EXAMPLE 60. Let NV =n =2 and consider the function 


fn) = (n3)° + (9! + det)’. 


This function is trivially polyconvex and according to the proposition it is also strictly qua- 
siconvex at &) = 0 (choose A = 0 € R°, a?” = (0, 1), a? = (0,0), a! ! = (1,0), B= 1). 


PROOF OF PROPOSITION 58. We will prove the proposition only in the case N =n = 2, 
the general case being handled similarly. 


Assume that, for a certain bounded domain U Cc R? and for some gE Wy (U7; R2), 
we have 


/ f (& + Dg(x)) dx = f (>) meas(U) 
U 
and let us prove that y = 0. This is equivalent, for every w € R™@), to 


[ f (G0 + Do(x)) — fo) — (a; T(éo + De) — ro) er 
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Choosing js = A (A as in the statement of the proposition) in the previous equation and 
using the polyconvexity of the function f, we get 


f (0 + Dela) — fF Eo) — (4; T(Eo + Dy(x)) — TEo)) =0 ace.xe@. 
We hence infer that, for almost every x € 92, we have 
(a; Dg’) =0 and (Cae Dg’) + (a! Dg’) + B det Dy = 0. 


Lemma 57, applied to the first equation, implies that g? = 0. Using this result in the second 
equation we get 


(a"; Dg'\=0 


and hence, appealing once more to the lemma, we have the claim, namely g! = 0. 


Summarizing the results of Theorem 51, Propositions 54 and 58, we get the following 
corollary. 


COROLLARY 61. Let f :R*" > R be lower semicontinuous, locally bounded and non- 
negative, &) € RN*" with 


Of (0) < f 0). 


If either one of the two following conditions hold 
Gi) Of (&) = Cf (Eo) and Cf is strictly convex at & in at least N directions, 
Gi) Of (&) = Pf(&) and Pf is strictly polyconvex at & (in the sense of Proposi- 
tion 58), 
then (QP) has a unique solution, namely ug,, while (P) has no solution. 


PROOF. The proof is almost identical under both hypotheses and so we will establish the 


corollary only in the first case. The result will follow from Theorem 51 if we can show that 
Of is strictly convex at &). So assume that 


i Of (& =F Do(x)) dx = Of (9) meas 2 


for some @ € Wy °°°(Q: IR") and let us prove that y = 0. Using the Jensen inequality 
combined with the hypothesis Qf (>) = Cf (&) and the fact that Of > Cf, we find that 
the above identity implies 


if Cf (& + Dy(x)) dx = Cf (&) meas 2. 


The hypotheses on Cf and Proposition 54 imply that g = 0, as wished. 
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We now conclude this section with a different necessary condition that is based on the 
Carathéodory theorem. 
Recall first that for any integer s, we let 


AY 
As = 4A =(Aq,...,A5): Ay SO and ya =i. 
i=l 


THEOREM 62. If (P) has a solution u € ug, + Wo: RY), then there exist ut © ANn+1 
and &, € RN*", |&,| < |lall ico, 1< v < Nn +1, such that 


Nn+1 Nn+l1 


Of &o) > >) uf) and k= D> wb. 
v=1 


v=1 


Moreover, if either n = 1 or N =1, the inequality becomes an equality, namely 


Nn+1 Nn+1 
ChE) = D> wv fE) and &= DY) rks. 
v=1 v=1 


REMARK 63. The theorem is just a curiosity in the vectorial case n, N > 1. However in 
the scalar case, n > N = 1, under some extra hypotheses (cf. Theorem 66), one of them 
being 

& € intco{é1, Ce) Ent}, 


it turns out that the necessary condition is also sufficient. But it is in the case N >n= 1 
that it is particularly interesting since then this condition is also sufficient, cf. Theorem 64. 


PROOF OF THEOREM 62. We decompose the proof into three steps. 


Step 1. Let u € ug + Wy (2: IR”) be a solution of (P). It should therefore satisfy 


1 
a / f (Dii(x)) dx = inf(P) = infQP) = Of (). (19) 
meas 22 Jo 


Let r = ||| yi.co and use the fact that f is locally bounded to find R = R(r) so that 
O< f(Di(x))<R aexe®. 
Denote by 
K, ={(,y) €RY™" xR: |é| <r and |y| < R}, 


epi f={@,y)e RY" xR: fe <y}, 
E=epifnNK,. 
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Note that since f is lower semicontinuous then epi f is closed and hence E is compact. 


Therefore its convex hull co E is also compact. 
Observe that, for almost every x € 2, we have 


(Dii(x), f (Dii(x))) e€E 
and thus by the Jensen inequality and (19) we deduce that 


1 
meas (2 


(fo. Of Go) = Ie (Dii(x), f (Di(x))) dx eco E. 


Appealing to the Carathéodory theorem we can find 4 € Ann+2, (&, vi) EE, LSI < 
Nn +2 (in particular, f (&;) < y;), such that 


Nn+2 Nn+2 Nn+2 


Of Go) = Do ai > DO FE) and Eo= DD AE. 
i=1 


i=l i=l 
(Note, in passing, that if f is continuous, we can replace in the above argument epi f by 
graph f = {(x,y)€R™*" xR: f(x) = y} 
obtaining therefore equality instead of inequality in the above statement.) 


Step 2. To obtain the theorem it therefore remains to show that one can take only (Nn + 1) 
elements. This is a classical procedure in convex analysis. The result is equivalent to show- 
ing that there exist uj, 1 <i < Nn +2, such that 


Mi 29, wer fi =1, at least one of the 4; = 0, 


(20) 
are <r are. eas ne: 


meaning in fact that 4 € Any+1 as wished. 

Assume that 4; > 0, 1 <i < Nn +2, otherwise nothing is to be proved. Observe first 
that &) € co{&,..., Enn+2} C RX". Thus it follows from the Carathéodory theorem that 
there exist v € Ann+2, with at least one of the vj = 0 (i.e., v € Awn+1), such that 


Nn+2 


Eyo= \> vidi. 


i=l 
Assume, without loss of generality, that 
Nn+2 Nn+2 


Yo uf Gi) > YO FED: (21) 


i=l i=1 
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otherwise choosing jj = v; we would have immediately (20). Let 
J={ie{l,...,Nn +2}: 4; — vj <O}. 

Observe that J 4 @, since otherwise 4; > v; > 0 for every i and since at least one of the 


v; = 0, we would have a contradiction with 5° v; = >> A; = 1 and A; > 0 for every i. We 
then define 


hi 
= min . 
Y ieJ | vj —Aj 
We clearly have that y > 0. Finally let 
Mi =A +yVAi—V), 1<icgNn+2. 


We immediately get that 


Nn+2 

pe; =O, x 4; =1, at least one of the yu; = 0. (22) 

i=l 
From (21) we obtain 
Nn+2 Nn+2 Nn+2 Nn+2 
y wien= So mserty( Sa seo— 5 wf) 
i=l i=l i=l i=l 
Nn+2 
< 0 MFG. 
i=l 


The combination of the above with (22) (assuming for the sake of notation that tyn+42 = 0) 
gives immediately 


Nn+1 Nn+l1 


Of (fo) > SY) uif Gi) and fo= D> pik. 
i=1 


i=1 


Step 3. The result for the scalar case follows from the fact that Of (&) = Cf (0) and from 
Theorem 6. 


6. The scalar case 


We now see how to apply the above abstract considerations to the case where either n = 1 
or N = 1. We recall that 


int{ 09 = [ f (Du(x)) dx: Hey + Wy(BR)], (P) 
22 
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We will first treat the more elementary case where n = | and then the case N = 1. 


6.1. The case of single integrals 
In this very elementary case we can get much simpler and sharper results. 


THEOREM 64. Let f :R — R be nonnegative, locally bounded and lower semicontinu- 
ous. Leta <b, a, BERN, N > 1, and 


b 
int{ 109 = [ f(u'(x)) dx: we x], (P) 
where 
X = {ue W'™((a,b); RY): u(a) =a, u(b) = B}. 


The two following statements are then equivalent: 
(i) problem (P) has a minimizer, 
(ii) there exist 4, >Owith DN*' a, =1, yw ERY, 1<v<N +1, such that 


v=1 


p-a N+1 B—a N+1 
cH(Fag) a Ltn) and Fah = Star (23) 


where Cf =sup{g < f: g convex}. 
Furthermore, if (23) is satisfied and if 


pal P 
y=[er oo Pinar -9 | l<p<N+H+1, 


v=1 v=1 
then 
P 
(x) = yp(x —a) + (b—a) ) Av —Yp) ta, XETp, 1<p<NH+l, 
v=1 


is a solution of (P). 


REMARK 65. (i) The sufficiency of (23) is implicitly or explicitly proved in the papers 
mentioned in the bibliography. The necessity is less known but is also implicit in the liter- 
ature. The theorem as stated can be found in Dacorogna [25]. 
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(ii) Recall that by the Carathéodory theorem (cf. Theorem 6) we always have 


Rew N+1 N+1 Boe 
or(5=2) =m] Yazoo ee a |. (24) 


Therefore (23) states that a necessary and sufficient condition for existence of solutions 
is that the infimum in (24) be attained. Note also that if f is convex or f coercive (in the 
sense that f(€) > al&|? +b with p > 1, a > 0) then the infimum in (24) is always attained. 

(iii) Therefore if f(x,u,&) = f(&), counterexamples to existence must be nonconvex 
and noncoercive; cf. Example 1, where 


1 
int{ r) =i e WO” des we Wy, ov}. (P) 
0 


ie., f(E) = nag then Cf (&) = 0 and therefore, by the relaxation theorem, 

inf(P) = inf(QP) = 0. 
However it is obvious that J(u) ~ 0 for every u € Wy °°, 1) and hence the infimum of (P) 
is not attained. 


(iv) A similar proof to that of Theorem 64 (see, for example, Marcellini [50]) shows 
that a sufficient condition to ensure existence of minima to 


b 
int{ 109 = [ f (x, u'(x)) dx: we x| (P) 


is (23), where 4, and y are then measurable functions. Of course if f depends explicitly 
on u, the example of Bolza (cf. Example 2) shows that the theorem is then false. 


PROOF OF THEOREM 64. It is easy to see that we can reduce our study to the case where 
a=0, b=1 and a=0. 


Sufficient condition. The sufficiency part is elementary. Let 


1 
int{ Te = / Cf (u'(x)) dx: we x], (QP) 
0 
where now 
X = {ue w!((0, 1); RY): uO) =0, ul) = Bh. 
Then u(x) = Bx is trivially a solution of (QP) and therefore 


inf(QP) = Cf (6). 
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Let now i be as in the statement of the theorem. Observe first that 7 ¢ W!~((0, 1); R) 
and u(0) = 0, u(1) = 6B. We now compute 


N+1 N+1 


1 
T(a) =| fli’ (@)) dx = ef f (a'(x)) dx = > f (vp) meas I, 
p=1"'P p= 


N+1 
= ApS (yp) = Cf (B) = inf(QP) < inf(P). 


p= 


Necessary condition. This has already been proved in Theorem 62. 


6.2. The case of multiple integrals 


We now discuss the case n > N = 1. This is of course a more difficult case than the preced- 

ing one and no such simple result as Theorem 64 is available. However, we immediately 

have from Sections 5.2 and 5.3 (Theorem 29 and Corollary 55) the theorem stated below. 

For some historical comments on this theorem, see the remark following Corollary 55. 
But let us first recall the problem and the notation. We have 


in| r0) =| f (Du(x)) dx: u € ug + wera], (P) 
7) 


where §2 is a bounded open set of R”, ug, is affine, ic., Dug, = & and f:R" > Risa 
lower semicontinuous, locally bounded and nonnegative function. Let 


Cf =sup{g < f: g convex}. 


In order to avoid the trivial situation we assume that 


Cf (&0) < f (&0). 


We next set 


K ={& €R": Cf(E) < fe)} 


and we assume that it is connected, otherwise we replace it by its connected component 
that contains &p. 


THEOREM 66. 
Necessary condition. If (P) has a minimizer, then Cf is affine in a neighborhood of &o. 
Sufficient condition. If there exists E C 0K such that &) € intcoE and Cf |guré} is 
affine, then (P) has a solution. 
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REMARK 67. (i) By Cf|£ujé9} affine we mean that there exist a € R”, 6 € R such that 
Cf) = (a5) +B  forevery § € EU {&o}. 
Usually one proves that Cf is affine on the whole of co E. 
(ii) The theorem applies, of course, to the case where E = 0K and Cf is affine on the 
whole of K (since K is open and é9 € K C intco K). However in many simple examples 


such as the one given below, it is not realistic to assume that E = 0K. 


PROOF OF THEOREM 66. The necessary part is just Corollary 55. We therefore discuss 
only the sufficient part. We use Theorem 29 to find u € ug, + Wy *°°(@) such that 


Du(x)EECOK ae.xEeQ 
and hence 
f (Dii(x)) = Cf (Du(a)) ae.xeEQ. 


Then use the fact that Cf gU;g} is affine to deduce that 


i Cf (Di(x)) dx = Cf (&) meas 2. 
Q 


The conclusion then follows from Theorem 41. 
We now would like to give two simple examples. The first one generalizes Example 3. 


EXAMPLE 68. Let N=1,n=2, 2=(0, 1)”, ug = 0, a > O and 


FO =(G 1) +(G =e)’. 
We find that 


2 


cf@=[e-1],+[e-@],, 
where 


x] {* if x >0, 
XxX — 
+ lo ifx <0. 


We therefore have that 
K={é eR’: &? <1oré} <a’} 


and note that it is unbounded and that Cf is not affine on the whole of K. 
Let us discuss the two different cases. 
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Case 1: a =0. This corresponds to Example 3. Then clearly Cf is not affine in the neigh- 


borhood of & = 0, since it is strictly convex in the direction e2 = (0, 1). Hence (P) has no 
solution. 


Case 2:a >0. We let 
E = {é €R*: |&|=1 and |&| =a} c aK. 


Note that & = 0 € intco E and Cf|cog = 0 is affine. Therefore the theorem applies and 
we obtain that (P) has a solution. 


EXAMPLE 69. We conclude with the following example (cf. Marcellini [51] and 
Dacorogna and Marcellini [27]). Let n > 2 and 


f (Du) = g(|Dul), 

where g : IR > R is lower semicontinuous, locally bounded and nonnegative with 
(0) = inf{ g(t): > O}. 

It is easy to see that Cf = Cg. Let 


S={t>0: Cg(t)<g@}, 
K ={& €R": Cf(® < f@}={E ER": Ele S}. 
Assume that &) € K and that S is connected, otherwise replace it by its connected compo- 


nent containing |&|. 
We then have to consider two cases. 


Case 1: Cg is strictly increasing at |§o|. Then clearly Cf is not affine in any neighborhood 
of &) and hence (P) has no solution. 


Case 2: Cg is constant on S. Assume that S' is bounded, this can be guaranteed if, for 
example, 


lim —— =-+00. 
t>+oo f¢ 


So let || € S = (a@, 6B) and choose in the sufficient part of the theorem 
E={é eR": |é|= 6} 


and apply the theorem to find a minimizer for (P). 
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7. The vectorial case 


We now consider several examples of the form studied in the previous sections, namely 
int{ 09 = [ f (Du(x)) dx: 1 eum + Wo (2iR™)], (P) 
2 


where (2 is a bounded open set of R”, ug, is affine, ie., Dug, = and f: RYX" _, Risa 
lower semicontinuous, locally bounded and nonnegative function. 
1. We consider in Section 7.1 the case where N =n and 


FE) = 8(A2l&),..-,An—1€), det é), 


where 0 < 41 (E) < +++ < An (SE) are the singular values of € € R"*". 
2. In Section 7.2 we deal with the case 


f(—E)=8(P)), 


where ®: R“*” —+ R is quasiaffine (so in particular, we can have, when N =n, ®(€) = 
det €, as in the previous case). 

3. We next discuss in Section 7.3 the Saint Venant—Kirchhoff energy functional. Up to 
rescaling, the function under consideration is (here N =n and v € (0, 1/2) is a parameter) 


_ leet 2 v 2 2 
£6) = |86" — 1)” + — (le? - 2) 


or in terms of the singular values, 0 < A1(€) <--- <An(&), of E € R"™", 


n n 2 
= 2 4\2 v oe. 
£@=02-1) + (2 r). 


i=1 
4. In Section 7.4 we consider a problem of optimal design where N = n = 2 and 


1+|é? ifé 40, 


r0={4 if =0. 


5. In Section 7.5 we deal with the minimal surface case, namely when N =n + 1 and 
f(5) = g(adj,§). 

6. Finally in Section 7.6 we discuss the problem of potential wells. 

We recall that, throughout Section 7, the sets O(n) and SO(n) will denote respectively 
the set of orthogonal and special orthogonal matrices, more presicely, 


O(n) ={ReER"™": RR! = 1}, 
SO(n) = {RE O(n): detR = 1}. 
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7.1. The case of singular values 


In this section we let N =n and we denote by 41 (&),..., An(€) the singular values of 
Ee R”™" with 0 <A, (E) <--- <Ay(E) and by Q the set 


O= {x = (%,...,%n-1) € R"*: OS x2 S++ Spt}, 


which is the natural set where to consider (A2(&), ..., An—1 (&)) for € € R”*”. 
The functions under consideration are of the form studied in Theorem 10, namely 


FE) =g(A2l€), ..., An—1), deté), 


and we have 


PFE) = OF (E) = RF (E) = Chet), 
where h: IR > Ris given by h(s) =inf,eg g(x, 5). 
We next apply the theory of Section 5.2 to get the following existence result established 
by Dacorogna, Pisante and Ribeiro [34]. 
THEOREM 70. Let 
FE) =8(A2€),..., An—1)) + (det), 
where g: Q > R is nonnegative, continuous and verifies 


inf g= g(m2,...,Mn—-1) withO<m2<---< mp] 


and h:1R > R is a nonnegative, lower semicontinuous and locally bounded function such 
that 


eee 


ItI>+00 |t| ee 
Then (P) has a solution. 
PROOF. We note that, by Theorem 10, Of (€) = inf g + Ch(det &). Letting 

K ={€eR™": Of @) < fé)] 


we see that 


K=L1,UL), 
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where 
Li = {& €R'": Ch(deté) < h(deté)}, 
Ly = {€ €R"": Ch(deté) =h(deté), inf g < g(A2(€),..., An—1€))}. 


We now prove the result. Clearly, if & ¢ K then wg, is a solution of (P), so from now 
on we assume that &) € K. There are three different cases to consider, one of them will be 
treated with Theorem 42 and the two others with Theorem 41. 


Case 1: &) € Lj. We first observe that hypothesis (25) allows us to write 


S={reR: Ch) <b} = J@;. 8). 


JEN 


Ch being affine in each interval (a;, Bj); thus Of is quasiaffine on each connected com- 
ponent of L; and 


Ly= {é € R’*": det& € Ue 6}. 
JEN 
Let (a;, Bj) be an interval as above such that det & € (a;, Bj). We get the result applying 
Theorem 42 with 
n n 
Ko= f eR": deté € (aj, Bj), | [ai&) <] [mi v =2, aa 
i=v i=v 


where m,, is chosen sufficiently large so that 


Mn-1 <Mn, (26) 
n n 
[Go <[][m. v=2.....0, (27) 
i=v i=v 
n 
max{|aj|, [Bj|} < ma] [mi. (28) 
i=2 


Clearly Ko C L; C K, moreover, (27) ensures that &) € Ko and (28) ensures the relax- 
ation property of Ko with respect to 


E={& eR": deté € {aj, Bj}, Av(E) =m, v=2,...,n} C KoN OK 
through Theorems 21 and 28 and the family of sets 


E;={& €R"™": deté € {aj +8, Bj — 5}, A: (€) =m; — 5, 1=2,...,n} 
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(cf. the proof of Theorem 1.1 of Dacorogna and Ribeiro [35] for details). Consequently 
Ko has the relaxation property with respect to Kg N 0K. 


Case 2: &) € Lz and det & #0. We consider in this case the set 


n n 
K, ={& eR": deté = det &, [[a@® < [ |. yada 


i=v i=v 


where m,, satisfies the conditions (26) and (27) of the first case (with strict inequality for 
the first one: my, > myp—1). It was shown by Dacorogna and Tanteri [37] that K, has the 
relaxation property with respect to 


E={£eR™": dete =detép, AE)l=— my, v= 2s5n}, 


and moreover, there exists u € ug, + We (2, R”) such that Du € E a.e. in 2. Since 
Of = f in E and Of (&)) = Of (Du), we can apply Theorem 41 and get the result. 


Case 3: & € L2 and det& = 0. We here just briefly outline the idea and we refer to 
Dacorogna, Pisante and Ribeiro [34] for details. Since any matrix € € R”*” can be decom- 
posed in the form RDQ, where R, Q € O(n) and D = diag(Ai(&), ..., An (&)) (cf. [45]) 
we can reduce ourselves to the case of &) = diag(A1 (&), ..., An (&)). In particular, as 
det & = 0, we have A; (&) = 0 and thus the first line of &) equal to zero. Let mp > myn_1 
and define 


Ky) =) eR™": €'=0, [aie <] [mi radeon 


i=v i=v 


E={& eR": &'=0, A;(&) = mj, i=2,...,n}, 


we get that K, has the relaxation property with respect to E. If we choose m, suffi- 
ciently large such that & € K; we can apply Theorem 25 to get the existence of u € 
Us) + Wy (@, R”) such that Du € E. Finally, as Qf = f in E and Of (9) = Of (Du), 
applying Theorem 41, we conclude the proof. 


7.2. The case of quasiaffine functions 


We next study the minimization problem 
in| [ g(®(Du(x))) dx: u € ug + Wy (@; R")|, (P) 
Q 


where (2 is a bounded open set of IR”, Dus, = & and 
e g:R-— Ris a lower semicontinuous, locally bounded and nonnegative function, 
e ®:R*" - R is quasiaffine and nonconstant. 
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We recall that in particular we can have, when N =n, ®(&) = deté. 
The relaxed problem is then 


int{ [ Cg(P(Du(x))) dx: uw € ue + Wy’ (2: Rr"), (QP) 
22 


where Cg is the convex envelope of g (here f(€&) = g(®@(&)) and we get Of = Cg, cf. 
Theorem 9). 
The existence result is the following theorem. 


THEOREM 71. Let 82 C R” be a bounded open set with Lipschitz boundary, g:R > R 
a nonnegative, lower semicontinuous and locally bounded function such that 


gO) _ 


|tI>+00 |t| a 


(29) 
and Ug, (x) = x, with & € R'*". Then there exists i € Us + Woe (2: RY) solution 
of (P). 

REMARK 72. This result has first been established by Mascolo and Schianchi [55] and 
later by Dacorogna and Marcellini [27] for the case of the determinant. The general case is 
due to Cellina and Zagatti [19] and later to Dacorogna and Ribeiro [35]. Here we see that 


it can be obtained as a particular case of Theorem 42. 


PROOF OF THEOREM 71. We will here only sketch the proof and we refer for details to 
Dacorogna and Ribeiro [35]. We first let 


S={teR: Cg(t) < g(t}. 


From the hypothesis on g we can write 


S=(J@.B;) 


JEN 


with Cg affine in each interval (a;, B;) and thus Qf is quasiaffine on each connected 
component of K, where 


K ={&eR*": d&) ES}. 


If (Eo) ¢ S then wz, is a solution of (P). In the other case, (&) € (a, B) C S for some 
a and £, and we apply Theorem 42 with 


Ko = {& €R**": ®(&) € @, B), 


acres Reena eo Peres 
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where ei, are constants sufficiently large so that &) € Ko and satisfying 
‘ goileel|) ot 
inf{|@(E)|: |&\| = ci} > max{la, |B|}. 
This condition allows us to obtain the relaxation property of Ko with respect to 


Ky N dK = {é € R**": @() € {az, B}, 


acess eerre hey cs ere 


The relaxation property is obtained using the approximation property (cf. Definition 27 
and Theorem 28) considering the sets, here 6 > 0 is sufficiently small, 


Hs ={& €RN*": BE) € {at 5, B — 4}, 
J Se 6b a1, ata FS Tecesr|. 


This concludes the proof of the theorem. 


The problem under consideration is sufficiently flexible that we could also proceed as 
in Dacorogna and Marcellini [27], using Corollary 47. Indeed if D®(&) 4 0 (in the case 
@(&) = deté this means that rank & > n — 1), we can apply the corollary, since the con- 
nected component of K containing & is bounded, in the neighborhood of &, in a direction 
of rank one. We do not discuss the details of this different approach. 


7.3. The Saint Venant—Kirchhoff energy 


The problem is now of the form 
int{ [ f (Du(x)) dx: u € we) + Wo"? (2: Rr), (P) 
Q 


where, upon rescaling, the function under consideration is, v € (0, 1/2) being a parameter, 


2 2 


ase v 2 
f(&) = |&& I|"+ (kl n) 


or in terms of the singular values, 0 << A1(&) <--- <An(E), of & € R"’*”, 


n n 2 
= 2 4)\2 v 2 
FO=VOA I + ms (S>. > 


i=l 


According to Le Dret and Raoult [49] the quasiconvex envelope and the convex envelope 
coincide, at least when n = 2 orn = 3, ie., 


Of () =Cf(é). 
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In the case n = 2, it is given by 


f&) if € ¢ Dj UD», 
Of@)=} “AQ3-1) if Do, 
0 if€ Dj, 


where 
{g eR*?: (1—v) [ar] + vfa)]° < Land 2(€) < 1} 
{E €R**: AVE) <2) <1}, 


{geR™ (vr @] + v2] <1 and 22(€) > 1}. 


D, 


Dy 


The existence theorem is the following one. 


THEOREM 73. Let 2 C R?, f and & be as above. 
(i) If & € D2 then (P) has a solution. 
(ii) If & € int D2 then (P) has no solution. 


REMARK 74. The nonexistence part has been proved by Dacorogna and Marcellini [27]. 


PROOF OF THEOREM 73. (i) The case where &) ¢ D; U D> corresponds to the trivial 
case, where Of (0) = f (0). So we now assume that &) € D;. Note that Of is quasiaffine 
on D, (in fact Of (€) = 0). Apply then Theorem 33 (and the remark following it) to get 
u € UE, + We: IR?) such that 


A, (Du) =dA2(Du) =1 ae. in 2. 


This implies that Of(Du) = f(Du) = Of (&) = 0 and hence the claim follows from 
Theorem 41. 

(ii) It was shown in [27], and we do not discuss here the details, that if & € int D2 then 
the function Qf is strictly quasiconvex at &) and therefore (P) has no solution. 


7.4. An optimal design problem 


We now consider the case, studied by many authors following the pioneering work of Kohn 
and Strang [48], where 


int{ [ f (Du(x)) dx: u € ug, + wy* (2; Rr), (P) 
Q 


2 C R’ is a bounded open set with Lipschitz boundary, Dug. = & and 


1+lg? if€ 40, 


r=(4 if =0. 
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It was shown by Kohn and Strang [48] that the quasiconvex envelope is then 


1+/é/ if |€|? + 2| deté| > 1, 


Of §)= 2(\g2 + 2\deté|)!/? — 2) dete] if [f2 +2) dete] <1. 


The existence of minimizers for problem (P) was then established by Dacorogna and 
Marcellini in [27] and [31]. Later Dacorogna and Tanteri [37] gave a different proof which 
is more in the spirit of the present report and we follow here this last approach. 


THEOREM 75. Let 2 C R*, f and & be as above. Then a necessary and sufficient condi- 
tion for (P) to have a solution is that one of the following conditions hold: 

(i) & =0 or |Eo|* + 2| det&| > 1 (i.e, f (Eo) = Of (0), 

(ii) det& #0. 


PROOF. We do not discuss the details and in particular not the necessary part (see [27] for 
details). So we assume that we are in the nontrivial case 


detéy £0 and |é|? + 2|deté| <1. (30) 


We just point out how to define the set Ko of Theorem 42. We have (denoting by Res? the 
set of 2 x 2 symmetric matrices) 


K = {€ € R°**: |é|* + 2|deté| <1} \ {0} 

Ko = {€ € Rj**: deté > 0 and traceé € (0, 1)}, 

Ko M dK = {O}U {é € R?**: deté > 0 and traceé = 1} 
= {€ © R}**: deté > 0 and traceé € {0, 1}}. 


Since f is invariant under rotations and symmetries and (30) holds, we can assume, without 
loss of generality, that & € Ko. Furthermore Qf is quasiaffine on Ko (Of (€) = 2traceé — 
2 det é), while it is not so on K. It remains to prove that Ko has the relaxation property with 
respect to Ky M 8K; and this is easily established as in [37]. 


7.5. The minimal surface case 


Following Dacorogna, Pisante and Ribeiro [34], we now deal with the case where N = 
n+ 1 and 


F (5) = g(adj,§). 


The minimization problem is then 


int{ [ g(adj,(Du(x))) dx: uw € we) + Wy (2; Ry], (P) 
Q 
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where {2 is a bounded open set of IR”, Dug, = 0 and g: IR"+! _, R is anonnegative, lower 
semicontinuous and locally bounded nonconvex function. 
From Theorem 9 we have 


Of (§) = Cg(adj,§). 


We next set 


S={yeR"*!: Cg(y) < g(y)} 


and assume, in order to avoid the trivial situation, that adj,,& € S. We also assume that S is 
connected, otherwise we replace it by its connected component that contains adj, &0. 
Observe that 


K ={& ERD, OF E) < fE)} = {EE ROTM: adj, é € S}. 


THEOREM 76. If S is bounded, Cg is affine in S and ranké) > n — 1, then (P) has a 
solution. 


REMARK 77. The fact that Cg be affine in S is not a necessary condition for existence of 
minima, as seen in Proposition 78. 


PROOF OF THEOREM 76. The result follows if we choose a convenient rank-one direction 
A=a@ B € R“*)** satisfying the hypothesis of Corollary 47. We remark that, since we 
suppose Cg affine in S, Of is quasiaffine in Lx (& + a @ Bz, A) (cf. Notation 44 and 
Definition 45) independently of the choice of 2. So we only have to prove that K is stably 
bounded at & in a direction A =a @ f. 

Firstly we observe that we can find (cf. Theorem 3.1.1 in [45]) P € O(n+1), Q € SO(n) 
and0 <A, <--- <Any, so that 


1<i<nt1 
f= PLQ, where L = (Aj8ij)iSjen 


in particular when n = 2, we have 


A, O 
L=(0 ia). 
0 O 


Since rank £9 > n — 1 we have that A2 > 0. We also note that 


adj, = adj,,P-adj,l and adj,L= 


(—1)"Aq +++ An 
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Without loss of generality we assume &) = L. We then choose A = a ® f, where a = 
(1,0,...,0) € R"*! and B = (1,0,...,0) € R”. We will see that Lx (&) + a ® Bz, A) is 
bounded for some ¢ > 0. Let n € Lx (9 +a ® Be, A) then we can write n = 9 +a @ye+tr 
for some y, € B, and t € R. By definition of Lx (&) +a ® Be, 4) we have adj, € SS. Since 
S is bounded and 


ladjnn| = |i + ye +t/A2-+-An, 
it follows, using the fact that rank &) > n — 1, that |t| is bounded by a constant depending on 


S, & and e. Consequently |7| < |&| + la ® ye| + |f||A] is bounded for any fixed positive ¢ 
and we get the result. 


As already alluded in Section 5.3, we obtain now a result of nonexistence although the 
integrand of the relaxed problem is not strictly quasiconvex. We will consider the case 
where N =3,n=2 and f :R*** = R is given by 


FE) = g(adjoé), 
where g : IR? — R is defined by 
2 
gv) = (v7 ca 4) + vy + oa 
We therefore get Of (€) = Cg(adjyé) and 
CgQv) = [vz — 4]; + vy + ie 
where 


x ifx>0, 


bh = {; ifx <0. 


We will choose the boundary datum as follows 


uz (x) =a1x) + a2x2 


Ug, (x) = uz (x) =0 
uC) =0 
and hence 
ay, a2 0 
Dug, (x) = 0 = ( 0 0 5 adj Duley (x) = adjnéo = (0) , 
0 O 0) 


The problem is then 


int{ 09 = [ f (Du(x)) dx: ea + Wo (OER), (P) 
Q 
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Note also that Of (0) =0 < f(&) = 16. 
In terms of the preceding notations we have 


S={y eR*: Cg(y) < g(y)} ={y = On, ya, y3) ER: [yi <2}, 

K={€ eR”: OF) < f@)} = [Fe R™: adjng € S} 
and we observe that Cg is not affine on S, which in turn implies that Of is not quasiaffine 
Tae following result shows that the hypothesis of strict quasiconvexity of Qf is not 


necessary for nonexistence. 


PROPOSITION 78. (P) has a solution if and only if ug, = 0. Moreover, Of is not strictly 
quasiconvex at any &) € R?** of the form 


a, ad 
w= (0 v). 
0 O 
PROOF. 


Step 1. We first show that if (P) has a solution then ug, = 0. If u € ug, + Wee: R?) is 
a solution of (P) we necessarily have, denoting by v(&) = adjyé, 


|v (Du)| = 2, v2(Du) = v3(Du) = 0 
since 
Of (Dug) = Cg (adj, Dug.) = Cg (0) =0. 


The three equations read as 


23 Daa od ee 
Uy, Ux, — UZ Uy, | = 2, 
1.3 i se 
wl u3, —ulu3, =0, G1) 
1 42 a 
Ux, Ux, — Uy Uy, = 
Multiplying the second equation of (31) first by ue then by hs using the third equation 
of (31), we get 
yt Pa Be De Dn Be care Bed 29D OM O09 ee MD Boe > 2B 
0= Uy Ux Uy. ~ Uy Uy Uy = Uy Uy Uy ~ Uy Uy ly) = Uy, (uy, Uy, Wy Wy), 
a) 0s ee RS Rc ON a ORY Ps MN LY 7 
= Uy Ux Uy. ~ Uy ly Uy, = Uy Uy Uy ~ Uy Ua ly = Ux, (uy, Uy, WW) 


Combining these last equations with the first one of (31), we find 
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We therefore find that any solution of (P) should have Du! = 0 ae. and hence u! = 
constant on each connected component of $2. Since u! agrees with Ue, on the boundary 
of £2, we deduce that Uz, = 0 and thus ug, = 0, as claimed. 


Step 2. We next show that if ug) = 0, then (P) has a solution. It suffices to choose ul =0 
and to solve 


23 253 )_ : 
ee Mi =2. aerin 2, 
uw =ue=0 on 082. 


This is possible by virtue of, for example, Corollary 7.30 in [31]. 
Step 3. We finally prove that Qf is not strictly quasiconvex at any &) € R?*? of the form 
given in the statement of the proposition. Indeed, let 0 < Ry < Rz < R and denote by Br 
the ball centered at 0 and of radius R. Choose 4, u € C™(Br) such that 

(1) 4=0Oon 0Br and A =1on Br,, 

(2) 4=0o0n BRr\ Br,, / = 1 0n Br, and 

[ue + W(X x, + x2Hy5)| <2  forevery x € Br. 

This last condition (which is a restriction only in B Ry \BrR ,) 1s easily ensured by choosing 


appropriately R;, R2 and R. 
We then choose u(x) = ug, (x) + v(x), where 


g\(x)=—A(x)ug (x), 9 (X) = mx)x1 and g(x) = w(x)x2. 


We therefore have that g € Wo? (Br; R°), adj,Du =0 on Br\ Br, while on Br, we 
have 


adjy Du = (M7 + W(r1 May +.X2HLxy), 0, 0). 
We have thus obtained that Cg (adj, Du) = 0 and hence 


Of (0 + De) = Of (G0) =9. 


This implies that (QP) has infinitely many solutions. However since g does not vanish 
identically, we deduce that Q/ is not strictly quasiconvex at any & of the given form. 


7.6. The problem of potential wells 


The general problem of potential wells has been intensively studied by many authors in 
conjunction with crystallographic models involving fine microstructures. The reference 
paper on the subject is Ball and James [8]. It has then been studied by many authors in- 
cluding Bhattacharya, Firoozye, James and Kohn, Dacorogna and Marcellini, De Simone 
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and Dolzmann, Dolzmann and Miiller, Ericksen, Firoozye and Kohn, Fonseca and Tartar, 
Kinderlehrer and Pedregal, Kohn, Luskin, Miiller and Sverak, Pipkin, Sverak, and we refer 
to [31] for exact bibliographic references. 

In mathematical terms the problem of potential wells can be described as follows. Find 
a minimizer of the problem 


int{ [ f (Du(x)) dx: u € ug + WwW," (2; Rr), (P) 
2 


where 2 C R” is a bounded open set, wg, is an affine map with Dug, = & and f :R’'*" > 
IR is such that 


m 
fE=0 =e FeE=LJSOMA. 
i=1 
The m wells are SO(n)A;, 1 <i <m (and SO(n) denotes the set of matrices U such that 


U'U=UU' =1 and detU = 1). 
The interesting case is when 


&) € intRco E, 


and we have then that 


Of (0) = 0. 
Therefore by the relaxation theorem we have 
inf(P) = inf(QP) =0. 


The existence of minimizers, since Qf is affine on Rco E (indeed Qf = 0), for (P) is then 
reduced to finding a function u € ug, + WwW, °° (2; IR”) so that 


Du(x) € E= U SO(n) Aj. 


i=1 


The problem is relatively well understood only in the cases of two wells, i.e. m = 2, 
and in dimension n = 2. It is this case that we briefly discuss now. We therefore have now 
A, B € R2*? with 0 < det A < det B and we want to find u € Us) + Wo: R?), where 
2 CR? is a bounded open set, satisfying 


Du(x) € SOQ)AUSOQ)B ae.inQ. 


Nonconvex problems of the calculus of variations and differential inclusions 123 


The first important result is to identify the set where the gradient of the boundary datum, 
&, should lie. This was resolved by Sverak [73] who showed that 


det B — det 
Reco E = }& € R®*?: there exist0 <a < eee eee 
det B — det A 
pepe a Fe esa0) 
~"detB—detA ”’ ; 


so thatE=aRA +656! 


while the interior is given by the same formulas with strict inequalities in the right-hand 
side. 
We therefore have the following theorem. 


THEOREM 79. Let 2 C R* be a bounded open set 
&) €intRco E. 
Then there exists u € Ug) + Wy (2: IR?) such that 
Du(x)€ E=SOQ)AUSOQ)B ae. in 2 
and therefore (P) has a solution. 


This result was proved by Miiller and Sverak [61] using the so-called method of convex 
integration of Gromov [43] and by Dacorogna and Marcellini in [28] and [31] following 
the approach presented in Section 4.4, and we refer to [31] for details. 

The case where det A = det B > 0 can also be handled (cf. Miiller and Sverak [62], see 
also Dacorogna and Tanteri [37]), using the representation formula of Sverak [73], namely 


Reo E = {é € R?*?: there exist R, S€ SO(2), 0<a,B<a+ Bf <1, 
deté = det A = det B so that =aRA + BSB}. 
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1. Introduction 


Bifurcation theory provides a bridge between the Jinear world and the more complicated 
nonlinear world, and thus plays an important role in the study of various nonlinear prob- 
lems. Nonlinear elliptic boundary value problems enjoy many nice properties that allow 
the use of a variety of powerful tools in nonlinear functional analysis. In the past three 
decades, bifurcation theory has been successfully combined with these tools to yield rather 
deep results for elliptic problems. Traditionally bifurcation analysis was based on local lin- 
earization techniques, but more and more global analysis is involved in modern bifurcation 
theory. A highlight is the global bifurcation theory of Krasnoselskii and Rabinowitz (see 
[Kr,Ra]), which is resulted from the use of topological degree theory, general set point 
theory and a linearization consideration. The final result, generally known as Rabinowitz’s 
global bifurcation theorem (to be recalled later), has played a fundamental role in prov- 
ing a great number of existence results for elliptic problems. Making use of the maximum 
principle, one can study elliptic problems in the framework of ordered Banach spaces. The 
extra order structure greatly strengthens these abstract tools. An excellent presentation of 
these techniques up to the late 1970s can be found in Amann’s by now classical review 
article [Am]. 

In this chapter we intend to present some further results for elliptic boundary value 
problems, where bifurcation theory plays an important role in the proofs; we will focus on 
recent developments, well after [Am]. In Section 2 we discuss a new phenomenon, namely 
bifurcation from infinity caused by spatial “degeneracy” in the nonlinearity and determined 
by “boundary blow-up solutions”. In Section 3 we combine bifurcation argument and order 
structure to study a system of elliptic equations, and demonstrate that, apart from multi- 
plicity results, these techniques can be used to discuss the stability and the profiles of the 
solutions. In Section 4 we present some recent fine techniques in determining the exact 
number of positive solutions of elliptic equations over a ball; in particular, we give the 
proof of a long standing conjecture on the perturbed Gelfand equation. In Section 5 we 
discuss the usefulness of nodal properties of solutions in global bifurcation theory. Most 
of the problems discussed here have an open ending; related problems and open questions 
can be found in the remarks at the end of the sections or subsections. 

The choice of the topics in this chapter is subjective, and the bibliography is by no 
means complete. For clarity and simplicity, we present most of our results for problems 
with a specific nonlinearity, with the hope that the interested reader can easily extend them 
to more general situations. 

We have not tried to make this chapter entirely self-contained. Most of the results pre- 
sented here are proved in full, but some of them are only stated, with the proofs referred to 
the relevant references. The proofs not given here are either very technical or less relevant 
to our main theme here. We assume that the reader is familiar with the standard theory for 
second-order linear elliptic equations (see [GT] and [PW]) and standard nonlinear func- 
tional analysis (see [De]). 


Some classical bifurcation theorems. We recall several classical bifurcation theorems 
which form the corner stones for our analysis in this chapter; indeed, they are fundamental 
in the development of the modern bifurcation theory in general. 
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We first describe Rabinowitz’s global bifurcation theorem. Let E be a Banach space 
and R! denote the set of real numbers. We consider the nonlinear eigenvalue problem 


u=ALu+H(A,u), (A,u)ER! x E, (1.1) 


where L: E —- E is a compact linear map, H:R! x E — E is compact and continuous, 
and is o(||u||) for uw near 0 uniformly on bounded A intervals. We assume that H(A, 0) =0, 
and therefore we have the curve of trivial solutions {(A, 0): A € R!}. We are interested in 
the existence of nontrivial solutions (A, u) € R! x E and will denote the closure of the set 
of nontrivial solutions of (1.1) by S. 

Let r(L) denote the set of uw € R! such that there exists v € E \ {0} with v = wLv. 
It is well known that the possible bifurcations points for (1.1) with respect to the curve of 
trivial solutions lie in the set {(w, 0): 4 € r(L)}; moreover, if uw € r(L) is of odd (algebraic) 
multiplicity, then (i, 0) is a bifurcation point, see [Kr]. 


THEOREM 1.1 (Rabinowitz’s global bifurcation theorem [Ra]). Under the above assump- 
tions, if  € r(L) is of odd (algebraic) multiplicity, then S possesses a maximal subcontin- 
uum S, such that (,0) € S, and S,, either 

(i) meets infinity in R! x E, ive. S, is unbounded, or 

(ii) meets (j1,0), where 4 €r(L) \ {uw}. 


Next we recall two local bifurcation theorems due to Crandall and Rabinowitz 
[CR1,CR2]. Let E,, Ey be Banach spaces and J = (a,b) an open interval in R!. Let 
N(L) and R(L) denote the null space and range of a linear map L between Banach spaces. 


THEOREM 1.2 (Bifurcation from a simple eigenvalue [CR1]). Let E,, Ez and J be as 
above. Suppose that U is a neighborhood of 0 in E,, 49 € J and F: J x U — Ez has the 
following properties: 

(a) F(A,0)=Oforre J, 

(b) the partial derivatives F),, Fy, and Fyy exist and are continuous, 

(c) dim N(F, (Ao, 0)) = codim R(F;, (Ao, 0)) = 1, 

(d) Fru (Ao, O)uo € RUFi (Ao, 0)), where uo € E, spans N(F, (Ao, 9)). 
Let Z be any complement of span{uo} in E\. Then there exists an open interval Jo con- 
taining 0 and continuously differentiable functions i: Jo > R' and : Jo > Z such that 
A(0) = Ao, W(O) = 0, and if u(s) = sup +sw(s), then F(A(s), u(s)) = 0. Moreover, the so- 
lution set of F(A, u) = 0 near (Ao, 0) consists precisely of the curves {(A(s), u(s)): 5 € Jo} 
and {(A,0): A€ J}. 


If the equation F(A, uv) = 0 in Theorem 1.2 can be written in the form of (1.1), then 
conditions (c) and (d) of Theorem 1.2 become 


dim N(AoL — J) =codim R(ApL — I) = 1 
and 


uo¢ RAQL—TJ) if NAoL — J) =span{uo}. 
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If Ao € r(L) has the above properties, then one says that 1/Ao is a simple eigenvalue of L. 
Therefore Theorem 1.2 is usually known as the theorem of bifurcation from a simple eigen- 
value; it provides a much better description of the local bifurcation branch. 

Both Theorems 1.1 and 1.2 describe the situation that a nontrivial solution branch bi- 
furcates from a trivial solution curve. The following theorem describes the situation that 
a solution curve “changes direction” in the (A, uw) space. As will be discussed later, this 
theorem plays a vital role in obtaining exact multiplicity results. 


THEOREM 1.3 (Turning point theorem [CR2]). Let E,, Ez and J be as in Theorem 1.2. 
Suppose that V is aneighborhood of vo in Ej, X40 € J and F: J x V > E2 is continuously 
differentiable and has the following properties: 

(a) F(Ao, vo) = 90, 

(b) dim N(F, (Ao, vo)) = codim R( Fy (Ao, vo)) = 1, 

(c) Fido, vo) € R(Fu (Ao, vo)). 
Let Z be any complement of span{ug} in E,, where ug € E, spans N(F, (Ao, vo)). Then 
there exists an open interval Jo containing 0 and continuously differentiable functions 
4: Jo > R! and t: Jog > Z such that 4(0) = Ag, A’ (0) = 0, (0) = t’ (0) = O, and if u(s) = 
vo + sug + T(S), then F(A(s), u(s)) = 0. Moreover, the solution set of F(A, u) =0 near 
(Ao, Uo) consists precisely of the curve {(A(s), u(s)): 5 € Jo}. Furthermore, if F is k-times 
continuously differentiable (analytic), so are X(s) and T(s). 


Note that if we can somehow determine the sign of 4”(0) in Theorem 1.3, then we 
would know in which direction the solution curve is bent near (Ao, v9). For example, if 
n’"(0) < 0, then the solution curve is bent to the left, i.e., for values of A less than Ag. In the 
case 4” (0) = 0, it is possible that the solution curve does not change direction at (Ag, vo) 
but behaves like the curve x = y° at (0, 0) in the xy-plane. 


2. Bifurcation from infinity by spatial degeneracy 
In this section we use the problem 
—Au=aAu—b(x)|ul?-!u, lag =0, (2.1) 


to demonstrate how bifurcation from infinity can be caused by b(x) vanishing in a subset of 
the underlying domain £2. We call this behavior of b(x) a degeneracy in (2.1). Here £2 is 
a bounded smooth domain in R”, p > 1 and b(x) is a continuous nonnegative function 
over 92. Positive solutions of problem (2.1) can be regarded as steady-states of a biological 
species over the spatial region (2, whose growth is governed by a degenerate logistic law. 
When b(x) is replaced by b(x) + € with a small positive constant ¢, (2.1) describes the 
steady-states of a species governed by a classical logistic law. We will make use of (2.1) 
to study the perturbed problem and reveal that, for small ¢, the profile (or pattern) of the 
positive solutions for the perturbed problem can be determined rather completely. This is 
of interest in population biology; we will also use these results in Section 3. 
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2.1. Bifurcation from infinity and boundary blow-up problems 


We consider positive solutions of (2.1); as will become clear soon, for this case, the theory 
is rather complete. We note that by the strong maximum principle, a nontrivial nonnegative 
solution of (2.1) must be strictly positive inside £2. We assume that 2 := b~!(0), where 
§2o is an open connected set whose closure is contained in §2, and both 0§2 and 02 are 
smooth (say, C*). We denote by ae and A; 70 the first eigenvalues of —A under Dirichlet 
boundary conditions over $2 and Qo. esnbctinely. In general, we use AP (#) to denote the 
first eigenvalue of —A + ¢ over D under Dirichlet boundary conditions. 
If (2.1) has a positive solution, then we write (2.1) in the form 


—Au+ (b(x)u?—!)u =u 


and obtain that ae (b(x)u?—!) = X. Using the well-known monotonicity properties of 
a? (@), we deduce 


x i) = Q 
ay <AP (bur!) < ay? (bO)uP!) = aye 
since b(x) = 0 on £29. Therefore we have the necessary condition, 
Pipes ee Cae (2.2) 


for (2.1) to possess a positive solution. We claim that (2.2) is also a sufficient condition 
for the existence of a positive solution of (2.1). This can be proved by combining a global 
bifurcation argument with an a priori bound result. Indeed, by a standard application of 
Rabinowitz’s global bifurcation result, we know that there is a global branch of positive 
solutions I” := {(A, u)} bifurcating from the trivial solution curve {(A, 0)} at (A2,0). By 
the maximum principle and the fact that Aa is a simple eigenvalue, we conclude that the 
second alternative in Theorem 1.1 cannot occur and hence I” has to be unbounded in the 
space R! x C!(2). 


LEMMA 2.1. For any small 6 > 0, there exists C = Cs > 0 such that any positive solution 
of (2.1) witha < a — 6 satisfies |lull cig) <C. 


PROOF. By the standard L?-theory for elliptic equations and the Sobolev embedding the- 
orems, we only need to show the bound in the L°°({2) norm. Indeed, if we have the bound 
for u in L° (2), then the right-hand side of (2.1) has a bound in L™® (2). By the L?-theory, 
this implies that u has a bound in wr a(@) for any g > 1. Then the Sobolev embedding 
theorem shows that u has a bound in C!(22). 

From the continuous dependence of ae on D, we can find a small neighborhood of (20, 
say 925 = {x € 2: d(x, 20) < a}, so fiat a2 > #70 5 Let o° be a positive eigen- 
function corresponding to A260 , Then extend ¢° lag? to a smooth positive function over 22, 
which we denote by Q. Then it is easily checked that there exists Mo > O large such that 
for any A € OF? — 6] and all M > Mo, M¢ is an upper solution of (2.1). By the well- 
known Serrin’s epcenite principle (see, e.g., Theorem 2.7.1 in [Sa]), we can conclude that 
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any positive solution of (2.1) satisfies u < Mo@ in 92. This proves the a priori bound in the 
L®(Q) norm, as required. 


By Lemma 2.1 (and its proof), we see that the global branch I" of positive solu- 
tions of (2.1) can become unbounded only through a sequence {(A,,, u,)} C I satisfying 
hn > ae and ||u;||~. — oo. In particular, we have proved that (2.1) has a positive so- 
lution if and only if (2.2) holds. Moreover, (Ae , 0) is a point of bifurcation from 0, and 
OF, oo) is a point of bifurcation from infinity. 

Taking advantage of the special nonlinearity in (2.1), we can show that it has a unique 
positive solution when (2.2) holds. Indeed, for any fixed 1 satisfying (2.2), we can use the 
family of upper solutions constructed in the proof of Lemma 2.1 and a standard iteration 
technique to conclude that (2.2) has a maximal positive solution u*. If u is any other posi- 
tive solution to (2.1), then applying the strong maximum principle to the equation satisfied 
by u* — u we find that u* — u > 0 in 82. Therefore we have 


A= AP (bo) (ut)? !) > 02 (bu?!) =A. 


This contradiction proves the uniqueness. 

For each A satisfying (2.2), if we denote the unique positive solution of (2.1) by uy, then 
the global bifurcation branch I” can be expressed as I” = {(A, uy): Ae <A< pean Near 
the end point (A? ,0) of I”, the local bifurcation theorem, Theorem 1.2, gives a detailed 
description of the behavior of I”; here one relies on a linear eigenvalue problem. To better 
understand I” near its other end point Cas oo), instead of a linear problem, we need the 
following nonlinear boundary blow-up problem 


—Au=aAu—b(x)u? in Q\ Qo, ulag =, ulag =0. (2.3) 
Here by ula, = ©, We mean 
u(x) > co =when d(x, 0929) > 0. 
We have the following result (see [DH], Theorem 2.4). 
PROPOSITION 2.2. Foranyi €R! , problem (2.3) has at least one positive solution. More- 
over, it has a maximal positive solution U;, and a minimal positive solution U , in the sense 


that any other positive solution u satisfies U, <u <U,. 


REMARK 2.3. If there exist constants a > 0 and £2 > 6; > 0 such that, for all x € 22 \ Ro 
near 020, 


Bi[d(x, 20) |" < b(x) < Bo[d(x, 92)]*, 


then it is proved in [Du6], Theorem 3.2, that (2.3) has a unique positive solution. Whether 
the positive solution of (2.3) is unique without any extra condition on b(x) is an open 
problem. 


134 Y. Du 


The following result gives a rather complete description of u, for 4 close to Ao 


THEOREM 2.4. Denote Xo := at Then 
(i) uy — 00 uniformly on 20 as xX increases to ho, 
(ii) uy, > U,, uniformly in any compact subset of 82 \ 29 as d increases to Xo. 


PROOF. We first observe that u, increases as A increases. This follows from a simple 
upper and lower solution consideration, together with the uniqueness of u,. Suppose 
Ae <A<N< a Then wu,’ is an upper solution of (2.1). If ¢ is a positive eigenfunction 
corresponding to A%, then it is easy to see that e@ < uy, and is a lower solution to (2.1) for 
all small positive ¢. Therefore (2.1) has a positive solution u satisfying e¢ < u < uy. We 
must have u = uw) as (2.1) has a unique positive solution. Therefore uy, < uy’. 

The monotonicity of wa, in A implies that if we can prove (i) and (ii) along a sequence 
An — Ao, then the same conclusions hold for A — Ag. Let {5,} be a sequence of positive 
numbers decreasing to 0 such that 


Qn = {x © B: d(x, Ro) < bn} CCR YnF1. 


Denote A, = As Then re? < An < Ao and A, increases to A9 as n > oo. To simplify 
notation, we write u, = uy,. The proof below is divided into four steps. 


STEP 1. up(x) > 00 uniformly in any compact subset of 20. 


Let ¢o be the positive eigenfunction corresponding to Ap = re normalized by 
lPolloo = 1. Let K be an arbitrarily given compact subset of (29. Define 


ao = es Bo:= min po(*). 
Clearly 
ag > 0, Bo > 0, Un(X) Suy(x) Sag Vx € 29,Vn > 1. (2.4) 


Given any large number M > 0, we can find an open connected set K* satisfying K C 
K* CC { such that 


do(x) < aor Vx € 0K™. (2.5) 


By a standard interior regularity argument, ¢, — $9 uniformly on K*, where @, is given 
by 


—Adn = Anon, dnla2, =9, bn 20, Prlloo = 1. 
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Thus, by (2.5) and the definition of fo, for all large n, 


M . M 
—n(x)<ao VxeEdK", — 
Bo Bo 


Recall that b(x) = 0 on K*. Hence uy and (M/Bo)¢, satisfy the same equation —Au = 
A,u. It now follows from (2.4) and (2.6) that (M/6o)¢, and u, are, respectively, lower and 
upper solutions of the problem 


M 
Ori(x)> > Week, (2.6) 


—Au=dA,u in K*, uloxx =a. 
AS An < Ao < es ae it follows from the maximum principle that, for all large n, 


M M 
3 n(x) 2 


2 — WxrekKc kK. 
Un(x) Bo 5 x G 


Since M > 0 is arbitrary, this shows limy—+oo Un (x) = oO uniformly in K. This proves 
Step 1. 

Since 8p is C”, it satisfies a uniform interior ball condition: There exists R > 0 such 
that for any x € 0{2o, there is a ball B, of radius R such that B, C Qo and By N92 = {x}. 


STEP 2. Let x, € 0929 be such that 


Un(Xn) = min up(x). 
xEd 29 


Tf {un (xn)} is bounded, then we can find a constant o > 0 and a sequence Cy > © such 
that 


R 
Uin() 2 Un@Gn) + cnpx), whenever — <|x— yal SR, (2.7) 


where (x) = et —ynl? — eR” and Yn is the center of the ball By,,. 


A simple calculation gives 


Aw + dnb = (402|x — ynl2 —2No + An)ewr Ml? — Anew PR”, 


We can choose a large o > 0 such that 


AW) SAnW) Vx € By, \ Br2(yn), 


where Br/2(yn) = {x € RN: |x — yn| < R/2}. 
Choose a compact set K CC po such that K > Uo, Brj2(yn). By Step 1 and the 
assumption that {u,(x,)} is bounded, we can find a sequence cy, — oo such that 


—o R7/4 _ grok) 


Un(X) > Un(Xn) + en(e Vx € Brj2(yn) CK. 
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On the other hand, since A, < Ao, by the maximum principle, up(x) > Un (%,) Vx € Qo. 
In particular, uy(x) > un(xn) on 0B,,. Thus we see that uy, is an upper solution to the 
problem 


—Au=h,u_ in By, \ Brn), 


a ) (2.8) 
UlaBy, =Un(Xn), Ula Ben) = Un (Xn) + en(e aR Se Ok) 


But clearly, upn(%) + CnW(x) is a lower solution to (2.8). Hence, since Ay < ro < 


By B n 1 i i 
x n\Brjacy » by the maximum principle, 


tn 2X) > n(n) Henr(x), whenever 5 < |x —ynl <R, 
as required. 
STEP 3. limy-+ oo Un (x) = & uniformly on Qo. 
By the maximum principle, it suffices to show that 


Un(Xp) = gan Un (x) > OO. 
0 


We argue indirectly. Suppose that this is not true. Then by passing to a subsequence, we 
may assume that {u,(x,)} is bounded: uy (x,) < C for all n. 
Clearly u, is an upper solution to 


—Au=d),u—b*uP in Q\ Ro, Ulam =Un(Xn), Ulag =9, (2.9) 
where b* = ||b||.o. Since 0 is a lower solution, we see that (2.9) has a positive solution 
Un <Un. Replacing uy(x,) in (2.9) by its upper bound C, we similarly obtain a positive 
solution V of (2.9) satisfying v, < V on £2 \ Qo. In particular, || vp || L00(42\.29) 1s bounded. 
Then the L? estimates and the Sobolev embedding theorems imply that {v,,} is bounded in 
Cl(2 \ §29). In particular, |V vp (x,)| 1s bounded. Since 

Un(X) 2 Un(x) Vx EQ\ Qo and uUn(Xn) = Va(Xn), 


we have 


OUn (Xn) e OUn (Xn) <C 
OVn OVn 


for some Co > 0, where vy = (Yn — Xn)/|¥n — Xn|, and yy is as in Step 2. 
On the other hand, by Step 2, 


OUn (Xn) TF OW (Xn) 


= c,|20 Re~?®’] + 00 
OVn ae: OVy al | 
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as n — oo. This contradiction finishes the proof of Step 3. 
STEP 4. For any compact set K C PY 20, Un > Ur in C!(K) asn— oo. 
Here we need the following comparison result. 


LEMMA 2.5. Suppose that D is a bounded domain, a(x) and B(x) are continuous 
functions in D with |la||oo < 00, and B(x) is nonnegative and not identically zero. Let 
U1,U2 € C!(D) be positive in D and satisfy, in the weak sense, 


Lu; +a(x)uy — B(x)g(u1) <0 < Lug + a@(x)u2 — B(x)gtu2), x ED, 
and 


lim (uz — 1) <0, 
x—>0D 


where Lu = Vij [ajj(x)Ux; |x; is a uniformly elliptic operator with smooth coefficients ajj, 
and g(u) is continuous and such that g(u)/u is strictly increasing for u in the range 
infp{u1, u2} <u <supp{u4, U2}. Then uz < uy in D. 


Lemma 2.5 was proved in [DM], Lemma 2.1, when uw; and uz are C 2: the same proof 
works if they are only C!. 

Applying Lemma 2.5 we find that uy, < uni < U,.: Hence limy-s oo Un (X) = Ugo (X) 
exists and Ugo(x) <U,,.. It follows that woo satisfies (2.3) with A = Ao. Here the fact that 
Ugo = 00 ON OM follows from uy(x) < Un+1(x) and up(x) > oo uniformly on 0S2o by 
Step 3. Since U ,, is the minimal solution, we necessarily have uo =U ,,. 

Using Sobolev embedding theorems and L? estimates, we easily see that u, > U,, in 
C!(K) as n —> oo, for any compact set K C @ \ 929. This proves Step 4 and hence finishes 
our proof of Theorem 2.4. 


2.2. Perturbation and patterned solutions 


If we replace b(x) by b(x) + € in (2.1), we will see that its global bifurcation branch 
of positive solutions I, differs considerably from I”, no matter how small is the positive 
constant ¢. In this subsection we examine closely the evolution of I, as ¢ decreases to 0. 
We will see that some solutions on I, develop a sharp pattern as ¢ — 0, others do not. So 
we consider the problem 


—Au=)u—[b@) +¢€lu?, ulag =0. (2.10) 


As is well known, a standard global bifurcation consideration can be applied 
to (2.10) to yield an unbounded global branch of positive solutions I; := {(A, u)}, bi- 
furcating from the trivial solution curve at Ce , 0). Moreover, (2.10) can have a positive 
solution only if A > 4%; this can be proved by the same trick used to prove (2.2). For any 
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given A > OQ and alld < A, we can find M := My > 0 large such that any constant C > M 
is an upper solution of (2.10). Analogous to Lemma 2.1, this gives an a priori bound for all 
positive solutions of (2.10) with A < A. Therefore I’, can only become unbounded through 
i. — oo. Furthermore, (2.10) has a unique positive solution u5 for any 4 > 42, which can 
be proved by the same argument used for (2.1). Therefore 


Eesha en eae). 
The following result describes how I; evolves as ¢ > 0. 


THEOREM 2.6. Let uj and u} be the unique positive solutions to (2.1) and (2.10), respec- 
tively. Then the following hold. 
(i) fA? <a< bale then us — uy, uniformly on Q as € > 0. 
(ii) fA > A7°, then _ 
(a) us, — 00 uniformly on Qo as € > 0, en 
(b) uy > U, uniformly on compact subsets of 82 \ Qo as e > 0. 


PROOF. Recall that by an upper and lower solution consideration and the uniqueness of u,, 
we deduced that uw, (x) is increasing in 4. The same consideration can be used to show that 
us (x) is increasing in A, decreasing in ¢, and 


us (x) <uy(x) (2.11) 


whenever both exist. (One can also apply Lemma 2.5 to prove these properties.) 

Suppose now ae <i< eas Then by (2.11), we know that (us: € > 0} is bounded 
in L~®(&2). By elliptic regularity and the Sobolev embedding theorem, we see that {u5: 
€ > 0} is compact in C!(Q). Since ¢ > us (x) is decreasing, (2.11) implies that ud (x) — 
lime_, 9 u5 (x) exists for all x € 82. The above compactness conclusion then implies that 
un ud inC (2) and furthermore, ie is a positive solution of (2.1). Therefore we must 
have uo = uj, due to uniqueness. This proves conclusion (i) of the theorem. 

We next prove conclusion (ii). So we assume that 4 > ae 

Let 


Me = MIN Ug(X) =Ue(Xe), Xe € 2. 
xEM29 


We claim that m, — oo as ¢ — 0. Clearly this implies part (a). We prove this claim by an 
indirect argument and divide the proof into several steps. 


STEP |. Ifm, < M for some constant M and all ¢ > 0, then d(x¢, 0829) > 0. 


Since A > a (d), we must have ||u¢|| ,-0(~@) > oo as € — O, for otherwise u, increases 
to a positive solution of (2.1) with « = 0 as e decreases to 0, contradicting the fact that 
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(2.2) is a necessary condition for (2.1) to possess a positive solution. Let us now pick up a 
sequence &, — 0, and define @pn = Un /||Un|loo, Where uy = uy" We easily see that 


— Alin = Min —[b(x) t+ en] llunllBo a2, ainlag =0. 
It follows that 
SAG, <i: (2.12) 


Therefore 
[piwinPar <a f ar <aie 


and {u%,} is bounded in Wy 2(Q). This implies that, subject to a subsequence, u%, con- 
verges weakly in Wy?(2) and strongly in L4(2) (for all g > 1) to some u# € Wy? (2). 
We claim that a 4 0. Indeed, if 7 = 0, then from #, — 0 in L4(2) for all g > 1 we 
deduce (—A)~!%,, > 0 in the C! norm; in particular, (=A) iy 0 uniformly in 22. 
From (2.12) we deduce 


0 < tin <A(—A) ttn > 0, 
contradicting the fact that ||, ||oo = 1. This proves that a 4 0. 


An application of Lemma 2.5 shows that uy is bounded from above by U, on 24 := 
@ \ 9. From this we easily see that 7 =0 on 2,. Thus, as 029 is smooth, t|a, € 

1,2 
Wy*(2o). 

If ||Un lloo =U(Xn), Xn € §2. Then by Bony’s maximum principle (see [Bo] and [L]), there 
exists a sequence x, — x, such that limz—.o0 Aun (x,) <0 and hence, from the equation 
for uy», we obtain 


0 < Aun (Xn) — [bOn) + En Junin)”. 


It follows that &y ||un 25° < 4. Hence we may assume that &y ||un W251 — &forsome é > 0. 
Now we multiply the equation for #, by an arbitrary y € C$°(@o) and integrate 
over (20, and pass to the limit n — oo, to obtain that 


/ vi-Vyax = | (Aa — €a”) dx. 

20 20 

That is to say that “|, is a weak solution to 
—Au=(A—€u?")u, ula, = 9. 


By the weak Harnack inequality, we deduce # > 0 in 2p. 
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From the equation for %,, we see that — Au, is uniformly bounded on Qo. By standard 
interior L?-theory for elliptic equations (see [GT]), we find that , is bounded in W4(Q’) 
for any g > | and any compact subdomain 92’ of (29. By the Sobolev embedding theorem 
(see [GT]), we know that subject to a subsequence, a, > a in C!(2’). As i > 0 on Qo, 
and ||Un|loo > 00, we find that u,(x) — oo uniformly on any compact subset of (29. As 
€ — us is monotone, us — oo uniformly on any compact subset of $29 as e > 0. Thus we 
must have d(x;, 029) > 0 as e > 0. 


STEP 2. Ifm, < M for some M and all ¢ > 0, then {us (Xe)/dV_e} is bounded from above, 
where v, is a unit vector in RN to be specified later. 


It suffices to show that, for any sequence ¢, —> 0, {au;” (Xe, )/OVe, } has a subsequence 
which is bounded from above. Let us denote 


Un = us Xp =X,e, and 2,= {x € 29: d(x, 029) > d(x, d2o)}. 


Note that if x, € 0920, then 2, = (Qo, and if (2, is different from §20, then for large n, it 
is close to 2 by Step 1. Thus for any 2’ CC o, 2’ CC Q, for all large n. Clearly u,, is 
an upper solution to the problem 


—Au=dAu—[b@x)+ Ju? inQ\ Qn, ulag =0,ulaa, =Un(en), (2.13) 


and 0 is a lower solution. Therefore (2.13) has a positive solution v,, satisfying 0 < vy, < Uy 
in 2 \ 2p. AS Un (Xp) = Vp(Xn), it follows that 


dunn) — 9UnGn) 
dun SC 


where v, is the unit normal vector of 002, at x, pointing inward of §2,,. Thus it suffices to 
show that dvp(%,)/0V, is bounded. 

Clearly Co := max{A!/(P?—), M} is an upper solution to (2.13). By Lemma 2.5, we con- 
clude that vy < Co. This implies that —Av, has an L® bound on £2 \ 2, which is inde- 
pendent of n. Since, furthermore, 

(1) vnlag, iS aconstant which has a bound independent of n, and 

(2) for all large n, 082, is as smooth as $29 with the smoothness not depending on n, 
by the L?-theory of elliptic equations up to the boundary (see, e.g., [GT]), we see that, for 
any ¢ > 1, |lUn|lw20(2\@,) has a bound independent of n. By Sobolev embeddings and the 
uniform smoothness of $2, this implies that || vp ||¢1(\,q,) has a bound independent of n. 
In particular {|Vvp,(x,)|} is bounded, and thus {dv,(x,)/0v,_)} 1s bounded, as required. 


STEP 3. mp > COasée > 0. 


Otherwise we can find a sequence €, — O such that m,, is bounded. By Step 2, 
{0Un(Xn)/0V,} is bounded from above, where v, is the unit normal vector of 02, at xy 
pointing inward of {2,,. Here we follow the notation in Step 2. We show that this is impos- 
sible, and hence proving the claim. For all large n, 0{2, is as smooth as 0§2o and hence it 
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satisfies a uniform interior ball condition: There exists R > 0 such that for any large n and 
x € 0Q2,, one can find a closed ball B,. of radius R such that By C 2, and By NIAQyz = {x}. 
Let y, denote the center of B,, and define 

W(x) Seal? _ go? 


where o is a positive number to be specified. We may assume that €, < | for all n. Then, 


for any constant c satisfying 1 <c < en? and x € B,, \ B", where B” = {x: |x — yy| < 
R/2}, we have 


A[un(%n) + cW] + Alun nr) + ev] — en[unGn) +e]? 


Pp 
> conn! Fy? x Val? 2No| enc?| ee + v| 
c 


> ceo (0° R? — 2No) _ [un (%n) + va 


if o, c and n are large enough. We fix o at such a value. 


Choose a compact set K CC &o such that K > US2, B”. By the proof of Step 1, 


1/p 


Un — 00 on K. Hence we can find a sequence cy, — oo satisfying cy < en and 


Un(x) >M+enWlapr forallx edB" CK. 
Thus, uv, is an upper solution to the problem 


—Au=Au—é,u? in By, \ B", 


ulaB,, = Un (Xn), ulaBr =Un(Xn) + CnWlaBr. 


By our choice of o, for all large n, uy (xn) + Cn is a lower solution to this problem. Using 
Lemma 2.5 we deduce up > Un (Xn) + cry in B,, \ B”, and it follows that 


OUn (Xn) Ss Ov (Xn) = Cn20 Re7o® > oo. 
OVn Vy 


This contradicts the conclusion in Step 2. Thus the claim and hence part (a) in conclu- 
sion (ii) of the theorem is proved. 

It remains to prove part (b). By the above proved part (a), we see that un|aa, > CO 
uniformly as n — oo. By Lemma 2.5 we deduce uy < Un) < U,. Therefore uy > 
ug <U, as n — ov. It follows that uo is a positive solution of (2.3). Since U_, is the 
minimal positive solution, we must have up = U_,. The proof is complete. 
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It was proved in [Du3], Part I, Proposition 2.3, that the minimal positive solution U_, 
varies continuously with A € R! in the space X := C(Qy Ud), where Qy := 2 \ Qo, 
and X has the metric defined by 


[o,@) 
2-"dy(u, v) 
dina so -— 
“ae peace 


with 
= r) 
dy(u, v) = |lu—vile(a,), n= 4x € Nz: d(x, dL2o) S at 


where 5 > 0 is small enough. This implies that 
Poo = {(,U,): AER} 
is a continuous curve in R! x C(Q2,4 U0). If we define 


~ +0, x E Qo, 
3) = 
U(x), xE€Q4, 


and consider I. oo = {(A, U sire R}} as a continuous bifurcation curve at infinity, then 
Theorems 2.4 and 2.6 can be interpreted as follows: 

(i) The positive solution curve I’ = {(A, u,)} of (2.1) bifurcates from the trivial solu- 
tion curve Ip = {(A,0)} atA= ae , then joins the bifurcation curve from infinity P5-at 
A= ay 

(ii) As ¢ — 0, the positive solution curve I, = {(A, us )} of (2.10) approaches I” when 
rE A®, eae and it approaches Ee when > x. 

In order to better understand the profile of u3 (which is the unique positive solution 
of (2.10)), we consider w5 := e?~ re It is easily seen that w; is the unique positive solu- 
tion of the problem 


—Aw=dw-[1+e'b@)]w?, wlag =0. (2.14) 


Ae: 145, then by Theorem 2.6(i), we see that wS — 0 uniformly in Q as ¢ — 0. 
We now consider the case that 2 > A, 20 Tf we denote by 6, the unique positive solution of 


—Aw=aw-—w?, wiag =0, 


then by Lemma 2.5 we see that wy < 6,. Also by Lemma 2.5, we find that w; is non- 
increasing with e. Therefore w, %%) = = lim,_,9 w; (x) € [0, &,(x)] exists. Furthermore, on 
any compact subset K of 29, —Aw; = Aw; — (wj)? has an L©® bound from above 
independent of ¢. By the L? estimates and Sobolev embedding theorem we find that 


Bifurcation and related topics 143 


w; converges to w) in C!(K). By Theorem 2. ea) we see that w; — 0 uniformly 
on any compact subset of 2 \ Qo. It follows that we = = 0 over 2 \ Qo. 
Let a? denote the unique positive solution of 


—Aw=)w—w?,  wlag, =0. (2.15) 


By Lemma 2.5 we obtain wy > ae Therefore we > ne in §29. We show that we = ap 
in §29. Indeed, from the inequality —Aw; < Aw; < 16, we deduce that {w;} is bounded 
in Wy? (2) and therefore by a compactness argument, w; > wy weakly in Wy? (2) and 
strongly in L4(&2) for any g > | (we also use the fact that || w;||oo is bounded). Since 
wy) = 0 in 24 and 029 is smooth, we conclude that Wel. € Wo"? (20). It follows easily 
that w? |. is a week positive solution of (2.15). By standard elliptic pees wy is also 
a Classical positive seen But Opa is the unique such solution. Therefore oe 00 i in (2. 

We now find that we is a continuous function in 2, and as e > 0, wy > wy in "14 (92), 
and the convergence is uniform on any compact subset of (2 \ 029. We claim that this 
convergence is uniform over S2. From the above discussions, it is clear that we need only 
prove the following conclusion: For any given 6 > 0, there exists og > 0 so that 


w(x) <5 Ve € (0,00), Vx € Soy = {x € B: d(x, 820) < oo}. (2.16) 


Denote 2,5 = {x € 2: d(x, 820) < o}. Since A > oo for all small o > 0, A > ie 
Therefore the problem 


—Aw=Aw-—w?, wliae, =9, 
has a unique positive solution 67. If we extend 67 to be 0 outside (2,, then a simple 


compactness argument shows that 07 > 6° as o — 0 uniformly in 2. In particular, we 
can find o; > 0 small so that A > veal and 


o é 
OP (x) <5 Wx € Soy. ones 


On the other hand, let b(x) < b(x) be a continuous function such that b(x) = =0Oon ai 
and b(x) > 0 on Q \ Oe. Then by what has been proved above, we have wy > 67! 
uniformly on §2,,/2, where w; is the unique positive solution to 


—Aw=)w—[1+e 'b@)]w?,  wlag =0. 


By Lemma 2.5 we deduce wy < < W;. Choose o9 < 01/2 such that for ¢ < 09, 


6 
wy <6; + 5 on Qo, /2: 
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Therefore, by (2.17), for ¢ € (0, 09) and x € Soy C So, /2; 


€ 
~o 
1) 


5 
< WSO +5 <4, 
that is, (2.16) holds. We have thus proved the following theorem. 


THEOREM 2.7. Suppose that i > a Then the unique positive solution wy of (2.14) 
converges uniformly to wy on Q as ¢ > 0. 


Let us observe that Theorem 2.7 gives a clear description of the pattern of w; for small 
€ > 0: It is close to 0 over 2 \ §29 and close to a definite positive function oy over £20. 


2.3. Comments and related results 


Positive solutions of problem (2.1) seem first considered by Ouyang [Ou], motivated by 
some geometric questions. Soon after, the results in [Ou] were extended in several di- 
rections by a number of authors. For example, Fraile, Koch-Medina, L6pez-Gémez and 
Merino [FKLM] used an upper and lower solution argument to obtain a priori bounds, 
which greatly simplified the arguments in [Ou]. The proof of our Lemma 2.1 follows the 
approach of [FKLM]. Theorem 2.4 was proved in [DH]. Under some extra conditions 
on b(x) near 0§2o, similar results were proved in [GGLS]. More references can be found 
in [DH]. Theorem 2.6 is taken from [Du3], Part II, and Theorem 2.7 from [DL]. 

The restriction that $29 is connected can be relaxed to the situation that it has finitely 
many components, each with smooth boundary; the techniques here can be easily adapted 
to deal with this case. Related results can be found, for example, in [Lop2] and [DL]. 

If $29 is not contained in @, then some of the techniques here collapse, though it is 
expected that similar results hold. The case that 029M 082 4 Y was discussed in [DG]. 

For the existence and uniqueness of positive solutions of (2.1), the smoothness condi- 
tion on b(x) and {29 can be greatly relaxed, see [dP] and [Da8]. How to extend Theorems 
2.4 and 2.6 to these situations remains to be investigated, though partial results were ob- 
tained in [dP]. 

We now come back to (2.1). By Theorem 2.4, we know that the branch of positive 
solutions bifurcating from the trivial solution at A = v2 blows up as A approaches a 
If ae denotes the kth eigenvalue of —A under Dirichlet boundary conditions, and we 
define ae similarly, then by Rabinowitz’s global bifurcation theorem, a global branch of 
nontrivial solutions I; of (2.1) bifurcates from the trivial solution branch at 7 = xe if 


Ae is of odd algebraic multiplicity. If J is unbounded, then must it blow up at A = A, 9 
From Section 2.1, we know that this is the case when k = 1. In [DO] several special cases 
were considers where bifurcation branches starting from ae (k > 1) indeed blow up at 
A=), 0 Whether this is true in general remains open. Nettuno we have the following 
result Ges [DO]), which shows that the set {A,"": 20. k > 1} contains all the possible A values 
where bifurcation from infinity can occur. 
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THEOREM 2.8. Given any large positive constant A and open neighborhood V of the 
finite set 


M = {a00: Af? < A,k > 1}, 


we can find a constant C depending on A and V such that any solution (A, u) of (2.1) with 
A<Aandid¢€V satisfies 


Ilullb~ <C. 


PROOF. We argue indirectly. Suppose that we can find a sequence of solutions {(Ay, Un)} 
of (2.1) such that A, < A,An € V, and ||up||L<° — oo. Clearly we have 


[ivuntae <n f ur dx. 
2 2 


It follows that A, > ae . Therefore, by passing to a subsequence, we may assume that 
An > AandA€ [A?, A]\ V. 


CLAIM 1. {uy} is uniformly bounded on any compact subset of Q4.:= 2 \ Qo. 

To prove Claim 1, we let K be an arbitrary compact subset of (2,. By our assumption 
on b, for some small neighborhood U of K, there exists t > 0 such that b(x) >t on U. 
Denote by V,, the unique positive solution of 

—Au=dAu—tu?, ulay =O, 
whose existence and uniqueness is well known (see [MV]). Choose 4* such that 4* > A, 
for all n > 1. We want to show that u, < V,* on K. Otherwise, we can find some n > 1 
and a domain Up CC U such that u, > V,* in Up and uy, = Vyx on 0Up. Hence on Up, we 
have 

—Auyn = Anun — b(x)ub 
and 


—AV jx > A* Vue — b(X)VE. 


An application of Lemma 2.5 on Uo yields uy, < Vi« on Up, a contradiction. 
Similarly, we find —u, < V,* on U. Therefore 


lUn| < Vax Vx €U, 


and Claim 1 follows. 
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Clearly this contradicts the fact that i ¢ V. Therefore our proof is complete once Claim 2 
is proved. Denoting ty = un/||Un||z- we find that 


[santa san f a2 dx < A|Q\. 
2 2 


Thus {i,} is a bounded sequence in W; 22). It follows that, subject to a subsequence, 
in converges to some u weakly in Wy?(2) and strongly in L?(Q). As it, has L® norm 1, 
we find that #, — win L4(2) for any q > 1. By Claim 1, we see that 7 = 0 over 24. Since 
do is smooth, it is well known that this implies vo := |) € Wy’ (20). 

We show next that vo 4 0. Otherwise, 7 = 0 over 2 and hence i, — 0 in L® for all 
q > 1. By Kato’s inequality (see [Kato]), we have, in the weak sense, 


x tek as A x 
—Aluin| < Ae <An|Un| < Alun. 
n 


Therefore 

0 < lin] < A(—A) "én. 
By standard elliptic regularity we find (—A)~!|a,| > 0 uniformly in Q. It follows that 
ln |ltc — 0 as n > oo. But this contradicts the fact that ||%,|| 00 = 1. Hence we have 
proved that vp 4 0. 


We now multiply the equation satisfied by a, by an arbitrary ¢ € Cj° (20), integrate by 
parts and find 


i, Viin - Vodx =, Anlun@ dx. 
20 20 


Letting n — oo we obtain 


[vm voar= f Auod dx. 
2 2 


This implies that vp € Wy’? (20) solves 
—Av=Av,  vlaq =0, (2.18) 


in the weak sense. Standard elliptic regularity shows that vo is also a classical solution 
of (2.18). As we have already proved that vp 4 0, we must have i= Fe for some k > 1. 


Thus A € M. This proves Claim 2 and hence concludes the proof of Theorem 2.8. 
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3. Bifurcation and monotonicity: A heterogeneous competition system 


Bifurcation and monotonicity have been combined to produce many nice results in nonlin- 
ear analysis, and a collection of these techniques and results may be found in [Am]. In this 
section we present some new applications. 

It is in general not easy to capture the influence of heterogeneous spatial environment 
on population models. Traditionally population models were considered in homogeneous 
spatial environment, and hence all the coefficients appearing in the models are chosen 
to be positive constants. To include spatial variations of the environment, these constant 
coefficients should be replaced by positive functions of the space variable x. However, the 
mathematical techniques developed to study these models are ironically either not sensitive 
to this change, in which case the effects of heterogeneous spatial environment are difficult 
to observe in the mathematical analysis, or the techniques are too sensitive to this change 
and become inapplicable when the constant coefficients are replaced by functions. 

In this section we use a competition model to demonstrate that bifurcation techniques 
are useful in capturing these spatial effects. Here we combine the bifurcation arguments 
with a certain monotonicity property of the system. A key in this approach is the following 
observation: The behavior of the model is very sensitive to certain coefficient functions be- 
coming small in part of the underlying spatial region. To make our ideas more transparent, 
we consider the following simplified steady-state competition system 


—Au=hu — [b(x) + e|u? —cuv, 
—Av=pv—v?—duv, (3.1) 


ulag =vlag =0. 


Here @ is a bounded smooth domain in RY (N > 2) and i, w,c,d are constants, with 
c >0,d > 0. The function b(x) is as in (2.1). We will see that when ¢ is small, the profiles 
of certain stable positive solutions of (3.1) are determined by the behavior of b(x). Our 
approach makes use of the facts that the global bifurcation branches for (3.1) with e = 0 
differs considerably to that for (3.1) with any ¢ > 0. By carefully following the changes of 
the global bifurcation branches of (3.1) as € shrinks to 0, we will be able to obtain a rather 
detailed global picture of the solution branches and to describe the patterns of the stable 
solutions. The techniques here can be used to study systems much more general than (3.1). 
We refer to [Du3,Du4] for discussions of the background. 


3.1. Global bifurcation 


We will fix ¢ > 0 and apply a global bifurcation analysis to (3.1), using jz as a bifurcation 
parameter. We are only interested in nonnegative solutions. Firstly let us observe some 
preliminary results. Clearly (u, v) = (0,0) is always a solution to (3.1), which is called 
the trivial solution. If (u, 0) 4 (0, 0) is a nonnegative solution of (3.1), then u is a positive 
solution of (2.10) with p = 2, namely 


—Au=au—[b(x)+e]u?,  ulag =0. (3.2) 
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It is well known that (3.2) has a unique positive solution when A > A, and there is no 
positive solution when A < a? . For’ > ae , we denote the unique positive solution of (3.2) 
by #;, and when the ¢ dependence is not emphasized, we will simply denote it by ¢,. 

If (0, v) ~ (0, 0) is a nonnegative solution of (3.1), then v is a positive solution of 


—Av=pv—v’, vlag =0. (3.3) 


Similarly to (3.2), there is a unique positive solution 6, to (3.3) when yu > ae , and no 
positive solution exists if 4 < re? . The solutions (#), 0) and (0, 6,,) are called semitrivial 
solutions of (3.1). 

We next discuss the positive solutions of (3.1), where both components wu and v are 
positive in §2. (By the strong maximum principle, if (u,v) solves (3.1) and u >, #40, 
v >, #40, then u > 0,v > 0 in 2.) Suppose that (3.1) has a positive solution. Then from 
the first equation we obtain 


A=AP([b&) +e]utcv) >a?O)=aP. 


Similarly, from the second equation we deduce jz > a . Therefore the following is a nec- 
essary condition for (3.1) to possess a positive solution: 


Ve EE (3.4) 

So from now on we fix A > ai. We also assume that ¢,c and d are fixed; wz will be 
considered as our bifurcation parameter. 

We now obtain some rough estimates for positive solutions of (3.1). Let (u, v) be a pos- 


itive solution of (3.1). Then wu is a lower solution of (3.2). Hence we can apply Lemma 2.5 
to deduce that u < ¢,. Similarly, v < 6,,. Using the above estimate for u we deduce 


—Av+ddyv > wv - v’, 
and by Lemma 2.5, v > v,,, where v, is the unique positive solution of 
—Av+ddg,v = pv — v’, vlag =0, 


provided that uw > ne (dg¢,,). We now show that there exists / > 0 large enough so that 
(3.1) has no positive solution when jz > (2. Indeed, we have 


A=AP ([DQx) + e]utcv) >A? (cup). (3.5) 
Since v, — ©o as 44 — oo uniformly on any compact subsets of (2, we can show that 


A? (Cun) — 00 as {4 > oo. Hence (3.5) implies that 4 < fi for some large (2. 
To summarize, we have the following result. 
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THEOREM 3.1. Suppose 07 > re? and &,c,d are fixed positive constants. Then there exists 
jt > 0 such that if (3.1) has a positive solution (u, v), then 


Ae pen: u<gdy, V< On <p. 

We now transform (3.1) into an abstract equation and apply bifurcation and monotonicity 
arguments to study its positive solution set. Choose M > 0 large enough such that for 
me[0,1+ fA] and0 <u <&:=1+4 |IPrlloo, O< v <9 := 1+ [lM%lloo, 

g(u,v):= Mu+au— [b(x) + e|u* —cuv 
is strictly increasing in u, and 

h(w, u,v) := Mv+ pov— v? — duv 
is strictly increasing in v. Then define 

A(u, u,v) =(-A+ M)"! (gu, v),A(u,u, v)), (u,v) € Eo, wER', 
where Ep := {(u, v) € C!(2) x C!(Q): ulag = vlag =O}. 

Clearly Po := {(u, v) € Eo: u <0, v > 0} is acone in Eo. It introduces a partial ordering 
in Eo: 

(uj, V1) <p) (U2, v2) tfandonly if (uz — uj, v2 — v1) € Po. 
Denote 


J :=[0,1+ “I, Ao := {(, v) € Eo: OS uu <E,0<u<ning}. 


It is easily seen, by the positivity of (—A + M)—!, that for fixed we J, A(u,u, v) is 
increasing over Apo in the order <p,, namely 


(uj, 01), (42,02) € Ap, (U1, V1) <py (U2, v2) implies 
A(, U1, V1) <Py ACH, U2, V2). 
Moreover, for fixed (u, v) € Ag, A(u, u, Vv) is increasing in pu: 
My <2 implies A(u1,u,v) <p) A(u2, u, v). 
If we use (uj,v1) <p) (U2, v2) to mean (uz — uj,v2 — v1) € int Po and use (uy, 
V1) <p) (uz, v2) to mean (uz — u1,v2 — v1) € Po \ {(0,0)}, then for w € J and 


(uy, V1), (U2, v2) € Ao, 


A(f, U1, V1) <py A(t, U2, v2) if (U1, V1) <p) (U2, v2) (3.6) 
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and for (u, v) € Ag with v 40, 
M1 <2 implies A(u1,u,v) <p) A(u2,U, v). (3.7) 


By the L?-theory and Sobolev embedding theorems we know that A:R! x Ey > Eo is 
completely continuous, and is continuously Frechet differentiable (in fact, it is analytic). 
Clearly (u, v) solves (3.1) if and only if it is a solution to 


(u,v) = A(u, u,v). (3.8) 


In the space R! x Eo, (3.8) has the trivial solution curve I := {(u, 0,0): w € R!}, the 
semitrivial solution curve I, := {(u,@,,0): we R} and the semitrivial solution curve 
P= (a0, Go A). 

It is well known (see [BB2]) that we can apply the local bifurcation result, Theorem 1.2, 
along J\ to find a unique value jo := neg (d@,) so that a branch of positive solutions 
of (3.8) bifurcates from I, at (449, Wa, 0) € 1. Moreover, a variant of Rabinowitz’s global 
bifurcation theorem (see [BB2], Theorem 3.2) can be used to show that this local branch 
can be continued globally, and by making use of the strong maximum principle and The- 
orem 3.1, it can be concluded that this global branch of positive solutions J” must join 
the semitrivial solution branch J4. One can apply Theorem 1.2 along I to find that 
(wu, 0,0@,0) is the only point on I> where positive solutions bifurcate from I>, where 


eS A is uniquely determined by 
A =A? (cO,0). (3.9) 


Therefore I~ joins I at the point (wu, 0, 6,0). 
Clearly the above global bifurcation analysis implies the following existence result. 


THEOREM 3.2. For any «1 between fo and 12°, (3.1) has a positive solution. 

We will demonstrate that by making use of the monotonicity property of the operator A, 
much more can be obtained. We will mainly follow the approach of [DB], though the 
presentation here is slightly different. Let us define 

A= {u ER!: (3.1) has a positive solution}, Ly = inf A, yu =sup A. 


By Theorems 3.1 and 3.2, clearly 


(3.10) 


> 


AY <p <min{uo,u°}, — max{uo, u°} <u* < 


Though it is highly unclear whether the positive solution branch I” contains all the pos- 
sible positive solutions of (3.1), we will show that 


is =inf{u eR’: (u,u,v) ET}, 
G.11) 
u* =sup{u eR’: (u,u,v) ET}. 
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To prove this and related facts, we need the following lemmas. 
LEMMA 3.3. Suppose that by. < yw. Then for every [L € (Lx, p°), (3.1) has a maximal 
positive solution (u",v"), in the sense that any positive solution (u,v) of (3.1) satisfies 


(u,v) <py (u*, v™). 


PROOF. Let pl € (1x, 1°) be fixed. Then A = A7?(c6,,0) > Aj’ (cO,.), and hence the prob- 
lem 


—Au=hu — [b(x) + elu? —cb,u, Uulag=0 
has a unique positive solution uo. If we denote vp := 6,,, then it is easily checked that 
A(LL, U0, Vo) <Py (Uo, VO). 


By the definition of ,, there exists (4 € [j1,, 4) such that (3.1) with w = jz has a positive 
solution (u, v). By Theorem 3.1 we have v < 6; < 6, in 92, and hence 


—Ait > ra —[b(x) +e]? -— cOyit. 


We now apply Lemma 2.5 and conclude that # > uo in 22. Therefore (@, V) <p, (Uo, U9). 
Clearly we also have A(j1, u, Vv) > py) (u, VU). If we define 


(Un, Un) = AC, Un—1, Un-1), n=1,2,..., 
we easily deduce that 

(4, V) <Py Uns Un) <Py Un—1, Va—-1) Py CUO, vO), nN=2,3,.... (3.12) 
A standard compactness argument shows that (uy, v;,) > (u“, v) in Eo and (u", v") = 
A(u, u,v). By (3.12), we know that (u“, v“) is a positive solution of (3.1). We claim 


that it is the maximal positive solution. Indeed, if (u, v) is any positive solution of (3.1), 
then by Theorem 3.1, v < 6, and hence 


—Au > hu - [b(x) + elu? — cOyu. 
By Lemma 2.5, this implies that u > ug. Therefore (u, v) <p, (uo, vo). It follows from this 


inequality and the monotonicity of A that (u, v) <p) (Un, Un) for alln > 0. Thus (u, v) <p, 
(u#,v"), 


LEMMA 3.4. If u* > to, then for every wt € (0, *), (3.1) has a minimal positive solu- 
tion (Up, Up)- 


PROOF. Let w € (U0, w*). Then pu > a (d@,,) and hence the problem 


—Av=pv—v’—dd,v, vlag =0, 
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has a unique positive solution vp. Denote up = ¢,. Then (uo, vo) satisfies A(z, Uo, V0) > Py 
(ug, v9). Choose jt € (wu, *] such that (3.1) with w = jf has a positive solution (a, v). Then 
it is easily checked that 
A(u, it, 8) <p (H, 5), (H, B) Sp (wo, 00). 
Define 
(Un, Vy) = ACM, Un—1,Un-1), nN=1,2,.... 
Then we have 
(ug, VO) <Py (U1, VI) SPy +++ K Py Uns Un) <Py ++ KP (U,V). 
Therefore (un, v,) converges to a positive solution (u,,, vj) of (3.1). Moreover, if (u, v) is 


any positive solution of (3.1), then (wu, v) =p) (uo, vo) and hence (u, v) > py (Un, Vn) for all 
n > 1. It follows that (u, v) > py (Up, Vp). 


THEOREM 3.5. The identities in (3.11) are true. Moreover, 
(i) if ws < °, then (u, u,v") € T for all w € (Ws, 2°), 
(ii) if u* > po, then (UW, Uy, Vp) € I forall w € (Wo, L*). 


PROOF. Clearly he > inf{u: (u,u,v) € I} and wo < sup{u: (u,u,v) € I}. Therefore 
we have nothing to prove if 4 = ju” and u* = Wo. 
Suppose px < 1°. Let us define, for pp € (wy, 4°), 
A” :=[, 00) x [(u", v), 00), 
where 
[(u", ul); co) = {(u, v) € Eo: (u,v) Spy (u", vy}. 
Since I connects (w°,0,6,0) € int A” and (119, ¢,,0) ¢ A”, it follows from the con- 


nectedness of I” that TN dA" #Q@. Let (f1,u,v) Ee FP NGA". We claim that (tu, u,v) = 
(u,u", v). Clearly 


JAY = [{} x [(u", v'), co) | U [[u. oo) x a[(u". vy, co) J. 
If = py, then since (u“, v“) is the maximal positive solution of (3.1), we necessarily 
have (u,v) <p, (u”, v*). On the other hand, we have (uw, v) € [(u”, v*), oo). Therefore 


(u, v) = (u*, v). We show next that jc > ys is impossible. Indeed, if 4 > jw, then we must 
have (u, v) € o[(u“, v), oo), ie., 


(i, 0) >p(u",v"), G1) Bp (u,v). 
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By the monotonicity properties of the operator A, we have 
(u,v) = A(t, U,V) > p, A(U, U,V) Sp, A(u, ul", v) = (u", vt), 
Now from (u,v) >p, (u“,v"), we further obtain A(yu,u,0) >p, A(u,u",v") and 
hence (u,v) >p, (u”, uv“). Therefore (2, u, v) € int A”, contradicting the assumption that 


(4, U, Vv) € OA". This proves assertion (i). 
The proof for (ii) is similar, where we use 


Ay = (-o, p] x (—00, (Cie vn) 
with 
(—00, (uy, Vu) | = {(u, v) € Eo: (U, v) <p) (Up, vp)}, 


and the fact that "N 0A, = {(u, Up, Vz) }. We omit the details. 
Clearly, (3.11) is a consequence of (i) and (ii). 


THEOREM 3.6. (i) If Wx < min{j19, 1°}, then (3.1) has a maximal positive solution 
(u’*,v"*) for bw = x and it has at least two positive solutions for each 
LE (Le, MIn{ Lo, peoyyi Moreover, all these solutions can be chosen from I. 

(ii) If w* > max{wo, 1°}, then (3.1) has a minimal positive solution for 4 = * and 
it has at least two positive solutions for each js € (max{j19, 1°}, u*). Moreover, all these 
solutions can be chosen from I. 


PROOF. Suppose 4x < min{j9, 19}. Let {tun} C (Wx, “°) be a decreasing sequence con- 
verging to x. By Theorem 3.5, (3.1) with « = fz, has a maximal positive solution 
(Un, Vn) = (u"", v""), Using the estimates in Theorem 3.1 and a compactness argument 
we easily see that, subject to a subsequence, (Uy, Un) > (Ux, Vx) in Eo, and (ux, vx) iS a 
nonnegative solution of (3.1) with uw = wx. Since fy is decreasing, by the monotonicity 
property of A we easily deduce that (un, Un) >> Py (Un+1, Un+i). Therefore ux > un > 0 
in §2. We claim that v, 40 in 92. Indeed, if v, = 0, then from the equation for uv, in (3.1) 
we easily deduce that u, — ¢, in Eo, and hence u, = ¢,. But then from the equation 
for vy, we deduce 


Mn = AP (Un + dun) > AY (dd,) = Ho. 


a contradiction to our assumption that 4, — x. Therefore (ux, vx) is a positive solution 
of (3.1) with pu = px. 

If (u,v) is any positive solution of (3.1) with ~ = ,, then by making use of the 
monotonicity property of A we deduce (u,v) <p) (Un, Un) for all n > 1. It follows that 
(U,V) <py (Ux, Vx). Therefore (ux, vx) is the maximal solution. The proof of Theorem 3.5 
shows that (Wx, Ux, Vx) ET. 

To show that (3.1) has at least two positive solutions for jw € (x, min{{Z0, w}), we 
use the following simple result from general point set theory, whose proof can be found 
in [DB]. 
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LEMMA 3.7. Suppose that X is a Banach space, C is a connected set in X and O an open 
set in X such that 0O \C consists of a single point. Then C \ O is a connected set. 


Now for fixed ps € (4x, min{j9, 1°}), we take C =I and O = int A”, where ji € 
(tx, LL). By the proof of Theorem 3.5, we know that JALAN T= {(i, ul, vy}. Hence by 
Lemma 3.7, the set J” \ int A“ is connected. Since (Lx, Ux, Vx) € I \ A and (40, @, 0) € 
r \ Ab, by the connectedness of I” \ A“ and the fact that LL € (tx, 40), we can find a 
point (u,u,v) ET \ A“. Hence (u,v) is a positive solution of (3.1). Since 4 < pu, we 
have (1, u,v) € int A”. Therefore (uw, v) and (u“, v/) are different positive solutions 
of (3.1), and both (uw, u, v) and (u, u”, v) belong to I. This proves (i). 

The proof of (ii) is parallel and we omit the details. 


REMARK 3.8. By the connectedness of I, if uw, < u*, then for any pw € (uy, UL”), 
(3.1) has a positive solution on I’. We will show in Section 3.3 that w* > max{j9, 1°} 
if ¢ > 0 is small enough. 


3.2. Stability analysis 


Suppose that (uo, vo) is a positive solution of (3.1). We want to know whether it is stable 
when considered as a steady-state of the corresponding parabolic problem 


u, — Au=dAu —[b(x) + Ju? — curv, xE€2,t>0, 
v, — Av = wv — v* — duv, xER2,t>0, (3.13) 
u=v=0, x€02,t>0. 


THEOREM 3.9. Suppose that (uo, vo) is a positive solution of (3.1), and there exists 
(h, k) € Po \ {(0,0)} and o € R! such that 


—Ah = hh — 2[b(x) + e]uoh — cuoh — cuok + ch, 
—Ak = wk — 29k — duok — duph + ok, (3.14) 
hlag =klag =9. 


Then (uo, vo) is asymptotically stable in Eo if o > 0, and it is unstable if o <0. 


PROOF. Since uo > 0 and vp > O in 22, we easily see from (3.14) that h £0 and k £0. 
Moreover, from the first equation in (3.14), we obtain —Ah < C(x)h in 2 for some 
C € C(Q). Therefore by the maximum principle and Hopf boundary lemma, we deduce 
h <Oin 2 and 0,h > 0 on 02. We similarly deduce k > 0 in 2 and 0,,k < 0 on 092. This 
implies that (h, k) € int Po. 
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For 6 € R! let us denote us := ug + 5h, vs := vo + 6k. Then a simple calculation gives 


—Aus = dus — [b(x) + e|us — CUsvs 
+ (o + d[b(x) + 6] + cdk) 5h, 
— Avs = vs — v3 — dusvs + (o +5 + dbh)6k, 


Uslag = Vslag =. 


(3.15) 


Due to (3.15) we can find 69 = d9(0) > 0 small enough so that, if o > 0, then for all 
6 € (0, do], 

—Aus < rus — [b(x) + e|us — CUsgvs, 

—Auv 3 > [Lvs — vy — dugvs, 


Uslag = Vslag =9, 


and for all 6 € [—d9, 0), 


—Aus > dus — [b(x) + €]u5 — cusvs, 
—Auvs < [Lvs — i — dugus, 
Uslac = Vslag =9. 
Hence (u3,, Us.) iS an upper solution of (3.1) and (u_—5,, v_s,) is a lower solution of (3.1). 
It is well known (see [Sm]) that the semiflow generated by the solution of (3.13) pre- 
serves the order <p,, and by the theory of monotone dynamical systems (see [Ma] or 
[Hir]), the following hold: 
(i) the unique solution (u(x,t), v(x,t)) of (3.13) with initial data (u_5,,v_4)) in- 
creases in the order <p, as ft increases; 
(ii) the unique solution (u(x, ft), v(x, t)) of (3.13) with initial data (v5), vs.) decreases 
in the order <p, as ¢ increases; 


(iii) (u—5p; V—3q) <P (u(t), v(, 2) <Py (a(-, 1), v(-, 1) <P (Uso; V5q) Vt > 0; 
(iv) (u@&), v(x) = limyo0(u@,t), ur, t)) and (u(x), v(x) = lim;+o0(u(x, ft), 
v(x, t)) exist and they are solutions of (3.1). 
Therefore we have 
(U—9, V-89) Py (ULV) KPy (U,V) <KPy (Usqs Vsq)- 
Define 
5, = inf {5 € [0, do]: (u,v) >A (ws, v-a)}. 


Then 0 < 6, < do. If 6, > 0, then 


(u,v) =A(u, u,v) Spy A(L, U—4,,, V—4,.) > Py (U—4,, V-5,)- 
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Therefore for all 5 < 6, but close to 6,, we also have (u,v) 2p) (u—s, v_s), contradict- 
ing the definition of 6,. This proves that (u,v) >p, (uo, vo). Similarly we can show that 
(u, V) <py (Uo, Vo). Therefore we must have 


(w(x), v0x)) = (4x), 1(x)) = (wo), vox). 


By the order preserving property of (3.13), we deduce that any solution (u(x,t), v(x, f)) 
of (3.13) with initial data taken from 


[ (uy, V—4y), (Usp; V5) | 


:= {(u, v) € Eo: (U5, V5) <Py (U,V) < py (Usp, V5q)} 


satisfies 
(u(-,1), 0,1) <p (wu, 06,0) <r (@6,0, 56,0) We>0. 


It follows that (u(x, ft), u(x, t)) > (uo(x), vo(x)) as tf > oo. By standard regularity for 
parabolic equations this convergence can be taken in the norm of Eo. This proves the as- 
ymptotic stability of (uo, vo) in Eo, since [(u—s9, V—s9), (Usq, Vso )] is an open neighborhood 
of (uo, vo) due to (h, k) € int Po. 

If o <0, then for all small 6 > 0, (us, vs) is a lower solution of (3.1). It follows that the 
unique solution (wu, v) of (3.13) with initial date (us, vs) increases in <p as f increases. By 
a simple comparison argument one sees that (u, v) stays bounded in the L™ norm for all 
t > 0. Hence by the theory of monotone dynamical systems (u, v) converges to a steady- 
state of (3.13) as f — 00, say (Ux, Vx). Clearly (Ux, Vx) S Py (Us, Us) >> Py (UO, VO). We can 
show that (u,, Vs) > Py (Uso, Vsy) by a Sweeping argument. Indeed, if we define 


5* = sup{n € [5, 60]: Ux, Vs) SP) (Uys Un)}; 
then by the monotonicity property of A and the continuous dependence on 6 of the (strict) 


lower solutions (us, vs), we easily deduce that 5* = 59 and (ux, Vs%) > Py (Usp, Usp). There- 
fore (Ux, Vx) ¢ [(U—49 V—59), (U5q, U5p)]- This implies that (uo, vo) is unstable. 


We now relate (3.14) to the spectral radius r(L) of the linear operator L: Ey > Eo, 
where L denotes the Frechet derivative of A(u,u,v) with respect to (u,v) at (ug, vo), 
namely 


L:= Davy ACU, U0, Vo). 
THEOREM 3.10. Let (uo, vg) be a positive solution of (3.1). Then (3.14) has a solution 
(h,k) € Po \ {(0,0)} with o > 0 if r(L) <1; it has a solution (h,k) € Po \ {(0,0)} with 
o <Oifr(L)>1. 


In the proof of Theorem 3.10, we will need the following version of the well-known 
Krein—Rutman theorem (see [De], Theorem 19.3, and [Am], Theorem 3.2). 
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THEOREM 3.11. Suppose that X is a Banach space with a positive cone P which has 
nonempty interior, and B is a compact linear operator in X, which is strongly positive: 
BCP \ {0}) C int P. Then r(B) > 0 and there exists a unique xo € int P such that Bxp = 
r(B)xo, ||xo|| = 1; there exists @ € X* such that @(x) > 0 for x € P \ {0} and B*¢ = 
r(B)¢. Hence Bx — r(B)x € P \ {0} for anyx € X. 


PROOF OF THEOREM 3.10. It is easily checked that L is compact and strongly positive 
in Eg. Therefore we can apply Theorem 3.11 to find (Ho, ko) € int Po such that L(ho, ko) = 
r(L)(ho, ko). Suppose r(L) < | and define, for o > 0, 


L,(h, k) = L(h,k) +0(—A + M)7!(h, k). 


Then L, is compact and strongly positive in Eg. Hence, by Theorem 3.11, r(Z,) > 0 and 
there exists a unique (1,4, k,) € int Po such that 


Lo (he, ko) =1r(Lo) (ho, ko), (20, ko) |g, = 1. 


By the uniqueness of (h,,k,) and a standard compactness argument, we easily see that 
r(L,) varies continuously with o. We also have 


o'r(Le)=r(o'L+(-A+M)"') >r((-A+M)')>0 aso>oo. 


Therefore r(L,) > 1 for all large o. Since r(Lo) = r(L) < 1, there exists o9 > 0 such that 
r(Loo) = 1, i.€., Loy Hogs Koy) = (Aap, Kop). It is easily seen that this implies that (Ag, , Koy) 
solves (3.14) with o = 09. 

Suppose now r(L) > 1. We then consider, for o > 1, the family of operators 


L°(h,k) :=(-A+o0M)7! 
x (gu(Uo, vo)h + Sv(Uo, Vo)K, My (uo, vo)h + hy (uo, vo)k). 


We easily see that L° is a compact and strongly positive operator in Eo, and hence by 
Theorem 3.11, there exists a unique (h° , k”) € int Po such that 


L°(n? kJ =r(L°)(h?,k?), (n° kD, = 1 


As before, by the uniqueness of (h° , k°) and a standard compactness argument, we easily 
see that r(L°) varies continuously with o. We claim that r(L°) — 0 as o — ov. Indeed, 
if we write L° (h° ,k°) =r(L°)(h° , k°) in its differential equation form, we obtain 


—Ah? +oMh® =r(L?) '[gu(uo, voyh® + gv (uo, vo)k?], 
—AK? + oMk? =r(L?) [hy (uo, voyh® + hy (uo, vo)k? J, 
ek pet 

a2 022 
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Therefore there exists a large constant C > 0 such that 
[ivi roma P)ax <r(ery'e ff (ine? + lar Pax, 
[ive P+ome?) av<r(Ley'e f (Wwf + lk?) de. 
It follows that 
r(L°)< a +0 asc>o. 
Since r(L!) = r(L) > 1, we can find o° > 1 such that r(L°’) = 1 and hence L°’(h?", 


k?°) = (n°, k°’). Writing this in the form of differential equations, we find that (h°", k7’) 
solves (3.14) with o = (1—0°)M <0. 


We now discuss the stability of the maximal positive solutions (u”, v“) and the minimal 
positive solutions (u,, v,) of (3.1). Suppose wy < w°, and for pu € (Wx, aay denote 


Lt = Da,» A(b, ul, vt), O*-= {u E (is bu): 7 bP) < i 


By Theorems 3.9 and 3.10, we know that (u“, v“) is asymptotically stable when jz € O*. 
Furthermore, by the implicity function theorem, O* is an open set and (u“, v) varies 
continuously with jz for 4 € O*. The following result shows that the measure of O* is the 
same as that of the interval (1, °). 


THEOREM 3.12. The set (1x, 1°) \ O* has measure zero in R!. 


PROOF. We use ideas from [Dul], Section 3. To simplify notation, we denote w(j) := 
(u“”, v“). From the monotonicity of A, we easily deduce that w(141) <p) W(442) when 
[1 < [L2. Moreover, w(jz) is right-continuous in jz. Indeed, suppose fz, decreases to 1; by 
a compactness consideration we find that subject to a subsequence, w(j4,,) > win Eo and 
w= A(t, W). Since W(t) <p) W(kin), we deduce w() <p, w. But w(jz) is the maximal 
solution and hence we necessarily have w = w(j). This implies that lim,-, +0 wu’) = 
w(1). We divide the rest of the proof into several steps. 


STEP 1. If w(u) is discontinuous at ft € (Ux, 1°), then W(fi~) := lim, a0 W(L) exists 
and A(fi, w(ft~)) = W(t) <p) wf). 


Let {tun} C (Ux, pw) be an arbitrary sequence increasing to 4. Then 
u(x) Sux) Sux), v(x) < vem) < vA (a). 


Therefore (a(x), 0(x)) := limp (u"" (x), v“" (x)) exists and the limit is independent of 
the choice of {j1,}. A simple compactness argument shows that w(,) > W:= (a, d) 
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in Eo. Clearly we have Ww = A(ji1, Ww). We must have w 4 w(t) for otherwise w(j) 
would be continuous at jz. Since w(jz) is the maximal positive solution, we must have 
W <p, W(jt). By the monotonicity of A we deduce w <p, w((). This proves Step 1. 


STEP 2. O* has the following alternative expression: 


— / 
on = [we (Hat) lim ONT +00}, 
p’—>u-0 U—-p- 


If i € O*, then by the implicity function theorem, we know that jz > w(j) is C! near fa 
and hence 


7 |W) — w(2) I 
im ————— 


b> ph 


= | DyWw(t) | < +00. 


Conversely, suppose that, for some sequence jz, increasing to (4, we have ||w(j) — 
W(Ln)||/( — Ln) > B € [0, +00). Then by Step 1, we know that w(jz) must be con- 
tinuous at (1. Denote z, := (w(t) — W(tin))/|| W() — Wty) ||. We obtain 


_ A(h, WA) — ACen, Wen) 
= |w(A) — wen) Ih 
= bn (D,, 
|W) — W(Hn)| 


A(ji, w(t)) + 0(1)) + L’ 2, + 0(1). 
Since Zo := D,, A(f, W(/2)) > py 0, the above identities imply that 6 > 0 and 

i Bo'20 + L" 2, +o(1). 
From this and the coaibae Hess of L/, it follows that, subject to a Subsequence, Zn > Z 
in Eo, and z= B~!z+ L“%. Since zp, > p, 0 and ||z, || = 1, we have z > p, 0. If r(L“) > 1, 
then we deduce 

L* (—2) —r(L")(—@ >p,@—L*a= p20 >p, 0, 


a contradiction to the last conclusion of Theorem 3.11. Therefore we must have r(L’) <i. 
This proves Step 2. 


STEP 3. If w(i2) is continuous at [i € (jr, 4°) and lim, a—o(w(2) — w())/(A — “) = 
+00, then there exists a(t) > 0 such that 


SUNS Se didwisn climes, (3.16) 
w- Ee > p—0 


where Wo € int Po is the unique solution to L“wo a r(L“)wo, |wo|| = 1. 
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Define z(j2) := (w(t) — w(2))/|| WC) — w()||. Then for 4 > fi — 0, we have 


_ Ali, w(A)) — A(u, W(H)) 


1M) = Twa) = wd 
fi~ be a : 
TwGi) wa) DH Ala WH) + 00) + EEa(u) +01) 


= L"2(u) + o(1). 


From this and a compactness argument and the uniqueness of wo we easily deduce that 
Z({L) > Wo as uw —> ft. Since wo > p) 0, we find that for all 4 < fi but close to jf, 
Z(t) = Py (1/2) wo and hence 


w(i) — w() Slew 
f-p 


where 


1 i) — 
yop lw) wll fener ee ep 
2 ww 


This proves Step 3. 
STEP 4. The set (Ux, w°) \ O* has measure 0 in R!. 


Let / be a nontrivial positive functional on Eo, i.e., 1 € 2. \ {0}, where P* := {e € 
E5: e(w) > 0 for we Po}. Define f: (ux, °) —>R! by f(u) =l(w(w)). Then f (i) is 
increasing and hence has finite derivatives almost everywhere in (1, 11°). 

If i € (uy, w°) \ O*, then by the conclusions in Steps 1-3, w() is either dis- 
continuous at ji, or it is continuous at fi but (3.16) holds. In either case we deduce 
(f (i) — f(u))/( — w) > +00 as w > fi — 0. Therefore (2, 1°) \ O* must have mea- 
sure 0). 


Let us now consider the stability of w(jz) := (u", v") for w € [Wx, yw) \ O*. We have 
the following result. 


THEOREM 3.13. Let (i € (Ux, °) \ O*. Then the following hold: 
(i) If w(w) is continuous at [i, then w(t) is asymptotically stable. 
(ii) If w(1) is discontinuous at fi, then w({) is unstable. 
(iii) If w() is discontinuous at fl, then w(f—) := lim,-. 0 W(4) is asymptotically 
stable. 


PROOF. We first claim that r(L”) = 1, where L” := Dw A(ji, W(j1)). Indeed, we can find 
[tn € O* decreasing to (2. It follows by the right-continuity of w(j) on yz that r(L*) = 
limy—+oo r(L4") < 1. Since 4 € O*, we must have r(L“) = 1. This proves our claim. 
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We can now easily check that all the conditions in Theorem 1.3 are satisfied by 
F(u, Ww) :=w— A(, W) with (Ao, vo) = (4, w(2)). For example, the condition 


FoAps w(it)) ¢ R(Fw(A, w(it))) 


follows from the last conclusion in Theorem 3.11, since F(t, wit) = —(0, vt) E 
(—Po) \ {(0, 0)} and Fy(f, w(a)) = I — L". Hence the solutions of w — A(w, w) = 0 
near (ji, w(j2)) form a smooth curve 


(u, W) = (u(s), WA) +5wo + T(s)), 8 €[—50, So], 0 > 0, 


with w(0) = f, w’(0) = 0, t(0) = t’(0) = 0, and wo >>p, 0 satisfies L“wo = wo. Since 
A is analytic, so are (s) and t(s). We cannot have j1(s) = 0 since by the right-continuity 
of w(w), 


(u, w()) > (A, w(f))  asuw—> A +0. (3.17) 


Therefore there exists some integer k > 2 such that u’(0) =--- = pw&DO) = 0 and 
uw (0) £0. We claim that (0) > 0, for if « (0) < 0 and k is even, then p(s) < fa for 
all small |s|, and hence F(u,w) =0 has no solution near (1, w(t)) with > (1, contra- 
dicting (3.17); if u (0) < 0 and k is odd, then for s < 0 close to 0, we have j(s) > fi and 
Ws = W(t) +5wot t(s) <p, w(t), which implies that for 4 > 1 but close to jz, the only 
solution (44, w) of F(z, w) = 0 close to w({2) satisfies w <p, w(/2), contradicting (3.17) 
and the fact that w(w) > p, w(t) for u > ft. Therefore we always have pw (0) > 0. 

If k is odd, then j1(s) crosses fu as s increases across 0. We show that w(,x) is continuous 
at (1. Otherwise by Step 1 in the proof of Theorem 3.12, w(u) > w(~) <p) w(jt) as 
ju > ft — 0. This implies that w(y(s)) <p) Ws for all s < 0 close to 0, contradicting the 
fact that w(j1(s)) is the maximal positive solution. This proves the continuity of w(jc) at (2. 

We may assume that so has been chosen small enough such that y(s) < f for s € 
[—so, 0), u(s) > f for s € (0, so], and 


Ws Kp w(t) for s €[—so, 0), Ws >p, W(t) for s € (0, so]. (3.18) 
By the monotonicity of A, we have 


ws = A(u(s), Ws) <p) A(f, Ws) for s €[—so, 0), 
ws = A(u(s), Ws) >~ ACA, ws) for s € (0, so]. 


Therefore {w;: s € [—so, 0)} is a continuum of strict lower solutions of (3.1) with uw = (1, 
and {ws: s € (0, so]} is a continuum of strict upper solutions of (3.1) with « = f. Now 
the argument in the proof of Theorem 3.9 can be repeated, with w,, s € [—sg, So] replacing 
(us, Us), 5 € [—d0, 50], to conclude that w(jz) is asymptotically stable. 

If k is even, then w(s) > fa for |s| small and hence there is no solution (jz, w) close 
to (4, w(f)) with x < fi. Therefore w(j) has to be discontinuous at ji. As before we 
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may assume that so is small enough such that (3.18) holds and w(s) > f for all s € 
[—so, So] \ {0}. Then 


Ws = A(1u(s), Ws) +P) Alii. Ws) for s €[-s0, 0), 


and hence {ws: s € [—so, 0)} is a continuum of strict upper solutions of (3.1) with uw = (2. 
By an analogous consideration as in the proof of Theorem 3.9, we find that the unique 
solution of (3.13) with 4 = 4 and with initial data w, decreases in the order <p, as ¢ in- 
creases, and it converges to a steady-state of (3.13) as tf — oo, say wy. Since Wy <pp Ws, 
it follows by a sweeping argument that w,. <p, W—s)- This implies that w(/2) is unstable. 

It remains to show conclusion (iii). So we assume that w(j) is discontinuous at j2. 
Let fin € O* be a sequence increasing to 2 and denote L := DywA(f, w(ji_ )). Since 
W(LLn) > w(f_) and r(L"") < 1, we deduce r(L) =lim,,99r(L"") < 1. If r(L) < 1, 
then the asymptotic stability of w(— ) follows from Theorem 3.10. Suppose next r(L) = 1. 
Then we can again apply Theorem 1.3 to conclude that the solutions of w = A(jz, w) near 
(j4, w(~ )) form an analytic curve: 


(1, W) = ((s), WA) +5wo + t(s)), 8 €[—S0, So], 50 > 0, 


with 4.(0) = f, w’(0) = 0, t(0) = t’(0) =O, and wo > p, 0 satisfies LWo = Wo. Since 
wi) > wf) asw—> f—O, (3.19) 


we must have j1(s) 4 0, and hence there exists k > 2 such that ’(0) =---= pw&k-D (0) =0 
and (0) £0. We claim that k is odd and w“(0) > 0. Indeed, if k is even and 
uw (0) > 0, then (s) > fi for |s| small. This implies that w = A(w, w) has no solu- 
tion close to (4, w(f)) with ju < j4, contradicting (3.19). If k is either odd or even, 
but uw (0) < 0, then for s > 0 small, w(s) < f@ and wy := w(fi-) + swo + T(s) > Py 
w(fi) >p) w(w(s)), contradicting the fact that w(j1(s)) is the maximal solution of (3.1) 
with 4. = «(s). This proves our claim. Now the asymptotic stability of w(j~) can be 
proved as before, since (3.1) with ~ = fi has a continuum of strict lower solutions 
{Ws: 5 € [—So, 0)}, and a continuum of strict upper solutions {ws: s € (0, sol}. 


REMARK 3.14. By standard regularity theory for parabolic equations, a steady-state 
(ug, Vo) of (3.13) is asymptotically stable in Ep implies that it is asymptotically stable 
in L(2)*. Under a slightly different definition for “asymptotically stable” solutions, the 
result of Theorem 3.13 was proved in [Da6] by a combination of fixed point index and 
local bifurcation argument. See also [Da7] for related results. 


We have parallel stability results for the minimal positive solutions (u,,, v,). More pre- 
cisely, suppose that jz* > jo and for ww € (Wo, “*) denote 


Ly = Dw A(U, Up, Vp), On = {ue © (uo. we"): r(Ly) < I}. 


THEOREM 3.15. The set (uo, U*) \ Ox has measure zero in R!. 
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THEOREM 3.16. zZ(u) := (Uy, vy) is left continuous in ({o, “*). Moreover, for 
ft € (uo, L*) \ O%, the following hold. 
(i) Ifz(2) is continuous at fi, then z(j1) is asymptotically stable. 
(ii) If z(2) is discontinuous at (1, then z({2) is unstable. 
(iii) If z() is discontinuous at fi, then 2(jit) := lim. +0 Z(H) is an asymptotically 
stable positive solution of (3.1). 


Theorems 3.15 and 3.16 can be proved by analogous arguments to those used in the 
proofs of Theorems 3.12 and 3.13. We omit the details. 


REMARK 3.17. If (u4*, v“*) exists, i.e., (3.1) has a maximal positive solution with 
[JL = [Lx, then by the proof of Theorem 3.13, we easily see that it is unstable. Similarly, 
if (U,*, Uy*) exists, it is unstable. 


3.3. Stable patterns 


We show that the global bifurcation branch of (3.1) discussed in Section 3.1 can be better 
described if ¢ is small. Moreover, we will show that, as e — 0, * — oo and the minimal 
positive solution (u,,, Vy) develops a sharp pattern determined by b(x). A key ingredient 
in our analysis here is the following degenerate model, that is, (3.1) with e =0 


—Au = du — b(x)u? — cu, 
—Av=pvu— v2 — duv, (3.20) 


ulag =vlag =0. 


We will regard (3.20) as a limiting problem for (3.1) with small ¢. In a sense, our strategy 
here is similar to that of Section 2.2, where the perturbed problem (2.10) was studied by 
making use of the limiting problem (2.1); here we study the perturbed system (3.1) by its 
limiting problem (3.20). We will mainly follow [Du4]. 

We firstly apply a global bifurcation analysis to (3.20). The following a priori estimate 
is crucial to our analysis; we refer to [Du4], Theorem 2.1, for its proof, which is quite 
involved and uses some ideas in Section 2. 


THEOREM 3.18. Given real numbers X and M, there exists C = C(A, M) > 0 such that 
any positive solution (u, v) of (3.20) with u < M satisfies 


le z~(2) + lull x(a) SC. 


Let us observe that (3.20) behaves similarly to (3.1) if ie <A< Po Indeed, we have a 
trivial solution branch J; Hg := {(u, 0,0): we IR!}, two semitrivial solution branches [, 0 = 
{(U, ua, 0): we R!} and iE = {(u,0,0,): b> xy; where ua is the unique positive 
solution of (2.1) with p = 2. Moreover, we can apply the local and global bifurcation 
analysis of [BB2] as in Section 3.1 to conclude that there exists a global bifurcation branch 
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of positive solutions of (3.20), denoted by I” 0 which bifurcates from I, at ({10, ua, 0) 
and joins ey at (2°, 0, 6,,0), where [ig = rp? (du,) and y° is given by (3.9). We now 
find that all our discussions in the rest of Section 3.1 and in Section 3.2 can be applied 
to (3.20) and yield the same results. Therefore we may conclude that when a»? <A< a 
(3.20) and (3.1) behave similarly. It is also easily seen that they behave similarly when 
AA 

We will show next that, when 


ae ee (3.21) 


essential differences arise between (3.1) and (3.20). We henceforth assume _ that 
(3.21) holds. The first difference is that the semitrivial solution branch ie disappears, 
though BY and [° are unchanged. We can still apply a local and global bifurcation analy- 
sis to (3.20): A local bifurcation analysis along I. 4 shows that a branch of positive so- 
lutions 7° bifurcates from ey at Gia: 0, 6,0) ef. oe by Theorem 3.18 and Rabinowitz’s 
global bifurcation theorem and the strong maximum principle, we find that °° is un- 
bounded through jz becoming unbounded. Moreover, if (3.20) has a positive solution 
(u,v), then w= re? (v+du) > Me Therefore 7° becomes unbounded through uw — +00. 
I® can be further described by making use of the monotonicity property of (3.20) as 
in Sections 3.1 and 3.2, and we collect these results in the following theorem (see 
[Du3] and [Du4] for a detailed proof ). 


THEOREM 3.19. Suppose 4 > 240(0). Then: 

(i) (Existence and nonexistence.) There exists [ly < p? such that (3.20) has no posi- 
tive solution for {4 < [tx, and it has at least one positive solution for [L > [Lx. 

(ii) (Multiplicity and stability.) If ji. < es then (3.20) has at least two positive solu- 
tions for ju € (jtx, “°), and at least one positive solution for 1 = jx. Moreover, at 
least one positive solution is asymptotically stable for w € (jx, 1°). 

(iii) (Continuum.) All the positive solutions of (3.20) stated in (i) and (ii) above can be 
chosen from the unbounded positive solution branch P° which joins the semitrivial 
solution (1°, 0, 4,0) and oo. 


REMARK 3.20. If d > 0 is small, then ju, < pe; see [Du3], Theorem 3.6, for some esti- 
mates of jx. 


We now come back to (3.1). To emphasize the dependence on ¢, we denote the global 
positive solution branch of (3.1) by I’, instead of I” used in Section 3.1. Let us observe 
that the trivial solution branch J and the semitrivial solution branch I> = {(j4, 0, 0,,)} are 
independent of ¢, as is 2° given by (3.9); but I, is e-dependent and we henceforth denote 
it by IY = {(u, @;, 0)}. Similarly, we replace ww. and * by x (€) and *(e), respectively. 
We also replace wo by o(e), which, we recall, is given by o(€) := 0? (dg§). Ase—> 0, 
the behavior of ¢; is described by Theorem 2.6. We now consider the behavior of juo(é) 
(see [Du3] and [Du4] for a proof ). 
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PROPOSITION 3.21. As ¢ > 0, Uo(e) = r? (dé) > are (dU ,), which is finite. Here 
24 :=2\ 2, U, is the minimal positive solution of (2.3) with p = 2, and ee (dU ,) is 
defined by 


Q 2 Q 3 
ri * (dU) = lim A; *(min{n, dU,}). 
Next we study the changes in w,(€) and u*(e) as e > 0. 


PROPOSITION 3.22. The functions ¢ > «*(e) and € > [1x(e) are both nonincreasing. 
Moreover, lime-+9 4* (€) = 00 and limg-+0 Wx (€) = [lx X fix, where [tx is defined in Theo- 
rem 3.19. 


PROOF. We first show that ¢ — j*(e) is nonincreasing. If *(e) = max{1°, Lo(e)}, then, 
since [o(e) = Ke (d@;) is nonincreasing with e, there is nothing to prove. If w*(e) > 
max{j1?, Lo(e)} for some ¢ = & > 0, then by Theorem 3.6, (3.1) with ¢ = €9 and uw = 
iu*(€9) has a positive solution (uo, vg). Let 1 € (0, eo]. Then 


—Aug < Aug — (d(x) + £1) UG — cuguo. 


Hence (uo, vg) is an upper solution to (3.1) with e = e;. Since uw = u*(€9) > Wo(Eo), if we 
choose €; close enough to €9, then > f4o(€1) and hence the problem 


—Av=pv—v'— dg;'v, vlag =0, 


has a unique positive solution vz,. It is easily checked that (o;', Ug, ) is a lower solution 
to (3.1) with ¢ = ¢,. Moreover, it is easily seen that b;. > ,° = uo and ve, < vo. Thus, 
by standard upper and lower solution argument for competition models, (3.1) with ¢ = 1 
has a positive solution (u, v) satisfying uo <u < Ue, and ve, < v < uo. By the definition 
of z*(e), we must have 4z*(e1) > uw = * (eq). Thus € > pe*(e) is always nonincreasing. 

The fact that ¢ > pj, (€) is nonincreasing can be proved by a similar argument. 

Next we prove that *(¢) > oo as € > 0. We view (3.1) as a perturbation of (3.20) and 
use a degree argument. Given any ju > max{A7* (aU ), tx}, by Theorem 3.18, we can find 
a constant C > 0 such that any positive solution (u, v) of (3.20) with yu € [0, 4] satisfies 
Il lloo < C. Note also that we always have v < 6, < 0%. We now recall the definition of 
A(t, u, v) in Section 3.1. By enlarging €,7 and M there, and replacing (2 there by jx if 
jt > (4, we find that the properties of A are retained for all small ¢ > 0. To emphasize the 
dependence on ¢, we denote A(y, u, v) by Ai (u,v). 

To use a fixed point index argument, it is convenient to work in the space E := C({2) x 
C(S2) with the natural positive cone P := {(u,v) € E: u >0,v > O}. If we define A:= 
{lu,v) € E: O0<u <&,0< v < n}, then it is easily checked that AR tA. — P and is 
completely continuous for all small ¢ > 0 and p € [0, 4]. Let us now consider the fixed 
point index, index p (AQ, A). When re < L < [Lx, the only nonnegative solutions of (3.20) 
are (u,v) = (0,0) and (u, v) = (0, 4,,), both are linearly unstable solutions of (3.20). By 
Dancer’s fixed point index formula [Da2], for such ju, 


index p (A), (0, 0)) = index p(A?, (0, 6,,)) =0. 
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Therefore, 
index p (Aj), A) = index p(A?,, (0, 0)) + index p(A?,, (0, 0,,)) =0. 


AS Ad has no fixed point on dp A (the relative boundary of A with respect to P) for any 
i € [0, jx], by the continuity property of the fixed point index (see [Am]), index p (Ap, A) 
is independent of jz € [0, jx] and is thus identically zero. 

Consider now pu € Gu; jt]. For such y, the trivial solution (0,0) of (3.20) is linearly 
unstable and hence has fixed point index 0, but the semitrivial solution (0, 6,,) is linearly 
stable, and therefore it has fixed point index 1. It follows that we can find small neighbor- 
hoods No of (0,0) and Nj of (0, 67) such that 


index p(A%, A\ (NoU M)) 
= index p(A?, A) — index p(A}, (0, 0)) — index p(A%, (0, 67) 


It follows from the continuity property of the fixed point index that, for all sufficiently 
small ¢ > 0, index p (Aj A\ (No U N1)) is well defined and equals index p (Ao. A\ (No U 
N,)) = —1. Thus Ay, has a fixed point (u, v) in A \ (No U N}), i-e., (3.20) has a positive 
solution with x = jf for all small ¢ > 0. In particular, 4*(e) > ft. As jf is arbitrary, this 
implies u*(¢) > co as e > 0. 

Let us now prove that limg_.9 Wx (e) < fx. Since wx(€) 1s nonincreasing with ¢ and 
Ux(€) < Ww, fix = lime+0 Ws(e) exists. If i, > fix, then since fi, < w°, we must have 
[x < fhe By Theorem 3.19, (3.20) with w = 1, has a positive solution (ug, vg). It is easily 
checked that (uo, vo) is a lower solution to (3.1) with uw = j. for any ¢ > 0. Moreover, 
since [ly < , A= AY (cO,,0) > ae (c6;,,), and thus, the problem 


—Au=dhu — (b(x) + e)u> —c0i,u, ulag=9, 


has a unique positive solution u*. Clearly (u*,;,) is an upper solution of (3.1) with 
[= [lx, and v9 < O%,, Uo S u*. Thus, (3.1) with «= fx has a positive solution, and 
hence 4x (€) < fly. But this implies fi, < fix, a contradiction. Therefore, we must have 
[lx X fle, a8 required. 


By Propositions 3.21 and 3.22, we find that, for small ¢ > 0, wo(e) < u*(e), and for 
fixed yu > a (dU), w € (oe), *(e)) holds for all small ¢ > 0. Therefore, (3.1) has a 
minimal positive solution (u¥, , Ui). We are interested in the profile of (u“,, a ase—>0. 
To simplify notation, we will denote this minimal solution by (u*, v*) when its dependence 
on j4 is not emphasized. For technical reasons, in the following theorems we require > 
ae (d Ui), where U), is the maximal positive solution of (2.3) with p = 2. Under some 
mild conditions on b(x), U, = U,, see Remark 2.3. 


THEOREM 3.23. Suppose that . > a and L > at (dU,). Then the following conclu- 
sions hold: 
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(i) (u®, v°) > (00, 0) uniformly on Ro, = = 

(ii) U, < lim, _,gu®, lim,.9u* < Oy Va S lim ,_,v*, lim, ov* < Vu, where the 
limits are uniform on any compact subset of 82 \ 20, (U_,,V_,) and (Uy, Vu) are re- 
spectively the minimal and maximal positive solutions of the boundary blow-up problem 


—Au = du — b(x)u? — cuv, xE4, 
—Av=pu—v*—duv, FER (3.22) 
ulag =vlag =9, Ulan =&, Via = 9. 


Moreover, for any positive sequence {é,} that converges to 0, {(u®", v°")} has a subse- 
quence that converges, uniformly on any compact subset of 82 \ 20, to a positive solution 


of (3.22). 


We omit the rather involved proof of Theorem 3.23 here, and refer the interested reader 
to [Du4]. Let us note that for small ¢ > 0, the above result shows that (u*, v®) exhibits 
a sharp pattern over the underlying domain §2: u® is large over 929 and is positive and 
of order 1 over §2,; v® is small over $29, and it is positive and of order 1 over 24. Our 
next result demonstrates that an intuitively clearer pattern is given by a rescaled version 
of (u*,v*), namely (u*°, v°) := (eu®, v®). It is easily checked that (u*°, v°) is a minimal 
positive solution of the following competition model 


—Au=hu — [e~!b(x) + Lu? —cuv, 
2 _ elduv, (3.23) 


ulag =vlag =9. 


—Av=pv—v 


Clearly (a*, v*) has the same stability properties as (u°, v’) in (3.1) when regarded as a 
steady-state of the corresponding parabolic problem of (3.23). 


THEOREM 3.24. Suppose that x > ae and |L > i (dU,). Then the following are true: 
(i) (“®, v°) > (6, 0) uniformly on 20, where, 6, is the unique positive solution of 


—Au=dAu—u* in 20, Ulaa =9. 


(ii) For any positive sequence En —> 0, {(ufr, v'n)} has a subsequence that converges to 
(0, V) uniformly on 82 \ 20, where V € C(Q \ 820) and is the second component of some 
positive solution (U, V) of (3.22). 


Again we refer the proof of Theorem 3.24 to [Du4]. The above two theorems give us a 
rather detailed description of the spatial pattern of the minimal positive solution (u/,, v;,) 
with small ¢ > 0. By Theorem 3.16, this solution is asymptotically stable exactly when its 
dependence on jz is continuous at jz, which is the case for almost all yw. If its dependence 
on yj is discontinuous at some /i, then 


(a°, 0°) = di (He o,) (3.24) 
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Fig. 1. Bifurcation diagram for (3.1) and (3.20). 


is a positive solution of (3.1) with 4 = (2, and it is asymptotically stable. Equation (3.24) 
implies that, for fixed small ¢ > 0, (u*, 0°) has the spatial pattern similar to (ui, i) with 
> pt but close to fl. 

The bifurcation diagram (Figure 1) describes a possible scenario of the global bifurcation 
branches for (3.1) and (3.20) with A > pede 


3.4. Remarks 


1. If 29 is not connected but consists of finitely many components, then our results in 
Sections 3.1 and 3.2 are not affected, and the results in Section 3.3 can also be extended to 
this case, see [Du4] for details. 

2. The strategy employed here for the competition model (3.1) has been used to study 
certain predator-prey models; see [DD2] and [DHs] for details, and [Du5] for a survey. 
Since the predator-prey models do not have any kind of monotonicity property, the tech- 
niques there are very different from here. 

3. It is an interesting problem to see what new features arise if we have at least two 
nonconstant coefficients in (3.1) that are close to zero in certain parts of the domain. 

4. Our method works as well if (3.1) has the following more general form 


— div(d) (x)u) = Aa, (x)u — [b(x) + €]u? — c(x)u, 
— div(d2(x)v) = waz(x)v — e(x)v? — d(x)uv, (3.25) 
Bulag = Bulag =0, 
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where the coefficient functions are positive except b(x) which is allowed to vanish on part 
of the domain, and the boundary operator B is either Dirichlet, or Neumann or Robin type. 

5. Ina series of recent papers, Hutson—Lou—Mischaikow—Polacik studied various per- 
turbations of the special competition model 


u; — wAu =a(x)u —u* — uv, (x,t) € 2 x (0, ov), 
v, — wAv=a(x)u—v2—uv, (x,t) €2 x (0,00), 
uy =v, = 0, (x,t) € 02 x (0, 00), 


and obtained interesting results revealing some fundamental effects of heterogeneous en- 
vironment on the competition model. We refer to [HLM,HLMP] and [HMP] for details. 
Further related results can be found in [AC,CC,CCH,Lop1,LS]. 

6. Several general approaches have been developed in the past two decades to 
study (3.25). For example, the method of monotone iterations and order preserving op- 
erators was developed and used by Pao [Pao], Koman and Leung [KL] and many others; 
the method of global bifurcation was introduced by Blat and Brown [BB1,BB2]; and the 
fixed point index approach was developed by Dancer [Da3,Da4]. These methods were 
applied to (3.25) with constant coefficients, but they work as well with nonconstant coef- 
ficients to yield similar results. Therefore it is difficult to rely on these methods alone to 
reveal the effects of heterogeneous environment on (3.25). 

7. The spatial behavior of positive solutions of the two species competition model has 
received extensive studies even in the constant coefficient case, i.e., when the spatial envi- 
ronment is homogeneous. In [KW], it was shown that, if the spatial domain £2 is convex, 
then problem (3.25) with constant coefficients and Neumann boundary conditions has no 
stable positive steady-state that depends on x, i.e., all its stable positive steady-states are 
constant solutions. On the other hand, in [MM], spatially variable stable positive steady- 
state solutions were constructed for certain nonconvex {2 (see also [KY]). In [DD1], it 
was proved that in the strong competition case, positive steady-states of (3.25) with con- 
stant coefficients tend to segregate over £2, i.e., uv is close to 0 with u close to max{w, 0} 
and v close to max{—w, 0}, where w is a sign-changing solution of a scalar elliptic equa- 
tion deduced from this competition system. In [LN2,LN1], the competition model with 
self-diffusion and cross-diffusion was closely examined and the existence and asymptotic 
profile of space dependent positive steady-states were obtained when certain parameters 
are large; see also [Mi] and [MK] for earlier result. 

8. It is more realistic to assume that the coefficients in the competition model are also 
dependent on time, for example, they are periodic in time as well as a function of the space 
variable x. The general case was systematically discussed in [He]. It would be interesting 
to see whether the results of Sections 3.1—3.3 here can be extended to this case. 


4. Bifurcation and exact multiplicity: The perturbed Gelfand equation 
Exact multiplicity of solutions to nonlinear equations is in general very difficult to obtain. 


In most nonlinear elliptic problems, the number of solutions is not only affected by the 
nonlinearity in the equation, it also depends on the geometry of the underlying domain 
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(see [Da5]). When the underlying domain is a ball, then for many classes of nonlineari- 
ties, it is possible to use a bifurcation approach to find the exact number of positive so- 
lutions (see, e.g., [OS1,0S2]). A key point is that, by the well-known result of Gidas, Ni 
and Nirenberg [GNN], under homogeneous Dirichlet boundary conditions, any positive 
solution on the ball is radially symmetric; this reduces the PDE problem to an ODE one 
and makes the exact multiplicity problem reachable. We will demonstrate this approach 
through the perturbed Gelfand equation, where a perturbation argument is also needed. We 
mainly follow [DLo2] and [Du2]. 

The perturbed Gelfand equation arises in the mathematical modelling of thermal reaction 
processes (see [BE], Section 1.3), which is of the following form: 


—Au=rel/O+") in 2, ulag =0, (4.1) 


where @ is a bounded smooth domain in R”, A is a positive constant known as the Frank— 
Kamenetskii parameter, ¢ > 0 is a small parameter representing the reciprocal activation 
energy and u stands for the dimensionless temperature. 

If e =0, problem (4.1) reduces to the well-known Gelfand equation 


—Au=rAe" in, ulag =O. (4.2) 
If we let v = e7u and w= ree!/©, then (4.1) becomes 
—Av=pe/"*”) in Q, vilag =0, (4.3) 
which has the limiting equation 
—Av=pe!/” inQ, vilag=0. (4.4) 


We will make use of both (4.2) and (4.3) to obtain a good understanding of (4.1) for small 
e>0. 

If e > 1/4, then it is easily checked that the right-hand side of (4.1) is an increasing con- 
cave function of u, and it follows easily that (4.1) has a unique positive solution for every 
2. > 0; see [BIS] and [CS]. For a general ¢ > 0, it is known that (4.1) has a unique positive 
solution for 0 < 74 « 1 and 4 > 1; and for 0 < e < 1, it is known that there exists a non- 
empty bounded open interval A C (0, 00) such that for A € A, (4.1) has at least three dis- 
tinct positive solutions u1(x) < u2(x) < u3(x); see [BIS,CS,Sh, Wiel] and [Wie2]. These 
results suggest that when ¢ > 0 is small, the global bifurcation branch {(A, u)} of (4.1) is 
roughly S-shaped. If the space dimension is one, then it is proved by the method of quadra- 
tures that this bifurcation branch is a continuous curve and is exactly S-shaped when ¢ > 0 
is sufficiently small [HM], and it was further shown that this is true when 0 < ¢ < 1/4.4967 
in [W1], and when 0 < ¢ < 1/4.35 in [KLi]. 

It had been conjectured that the global bifurcation curve of (4.1) is exactly S-shaped 
when the space dimension is two and 2 is a ball. (This kind of result is useful in under- 
standing the profiles of the solutions to the full exothermic reaction—diffusion system; see 
[MS] for details.) Parter [Pa] considered this case for the equivalent problem (4.3), and 
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gave estimates of four positive values be (€) < (8) < u(é) < p42(€) such that (4.3) has 
a unique positive solution if wu € (0, bh 6] U [f42(€), +00) and it has at least three posi- 
tive solutions if uw € [41 (e), u,(€)]. By using (4.2) as a limiting problem for (4.1), Dancer 
[Dal] proved, among other things, that for any small positive 49 > 0, one can find an 
€9 > 0 small such that if ¢ € (0, €9), then there is a constant A2(€) > O such that (4.1) has 
exactly three positive solutions if 4 € (Ao, A2(e)); it has exactly two positive solutions if 
A = h2(é); and there is a unique positive solution if A > A2(€). This leaves the conjecture 
unsolved only for the small A-range, 0 < A < Ao. This gap was finally filled in [DLo2], 
where apart from (4.2), the limiting equation (4.4) was also used; we will give a proof of 
this result further based on (4.4) only. 

As will become clear later, when the space dimension N is greater than two, the global 
solution curve of (4.1) needs not be S-shaped for small ¢ > 0; it is more complicated when 
3<N <9, and (4.2) will play an important role in understanding this. 


4.1. The limiting equations 


When £2 is the unit ball, the number of positive solutions to (4.2) was completely described 
in the well-known paper of Joseph and Lundgren [JL] based on a phase plane method. Their 
results are summarized in the following proposition. 


PROPOSITION 4.1. Suppose that Q is the unit ball in R™. Then there exists a finite 
value 2, depending on N, such that (4.2) has 
(i) no positive solution whenrX >. A<N <9), 

(ii) exactly one positive solution whenX =i, A <N <9), 

(iii) exactly two positive solutions when 0 <2 <d, (N = 1,2), 

(iv) an infinite number of positive solutions when . =2(N —2) 3<N <9), 

(v) afinite but large number of solutions when |A —2(\N —2)| 4 Ois small (3 << N <9), 

(vi) a unique positive solution when 0 < X. < 2(N — 2), and no positive solution for 
A > 2(N — 2) (N 2 10). 


Moreover, the solution set {(A, w)} is a smooth curve which can be illustrated in Figure 2. 


u(0) u(0) u(0) 


I 
t 


x i d 
(i) N =1,2 (ii) 35 N <9 (iii) N > 10 


Fig. 2. Bifurcation diagrams for the Gelfand equation (4.2) over the unit ball. 
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We now consider the other limiting equation (4.4). We will use a bifurcation argument 
to show that if 2 is a ball of any dimension, the positive solution curve {({1, v)} is exactly 
“C”-shaped. This is in sharp contrast to the Gelfand equation (4.2), whose positive solution 
set changes structure as the dimension of the underlying domain changes. For definiteness, 


we assume that @ is the unit ball B := {x € RY: |x| < 1}. For convenience of notation, we 
also denote 


fe)=fowy=e'", — fe(v) =el/OF. (4.5) 
The following lemma, with a difficult and technical proof, is crucial. 


LEMMA 4.2. Suppose 2 = B. If u is a degenerate positive solution of (4.4), that is, the 
linearized problem 


—Ag=puf'(u)g, glas =, 
has a nontrivial solution $, then @ does not change sign in B. 


PROOF. By [GNN], u is radially symmetric: u(x) = u(r), r = |x|; moreover, u(r) < 0 
on (0,1]. By Proposition 3.3 of [LN], ¢ is also radially symmetric, 6(x) = (r). Hence 


N-1 
$" +——4' + uf (wg =0 in[0,1], ¢/()=0,¢(1) =0. 


By the Harnack inequality (or a well-known uniqueness result for the above singular 
second-order ordinary differential equation), (0) 4 0. We may assume ¢(0) > 0. 
Direct calculations give 


fia =u7e "50 Wu >0, 
f’(u) =ute "d= 2). 


Hence 
f"W>0 foruwe (, 1/2), f"W <0 forwe (1/2, 00). 
One easily sees 


uf) 1 


ss eae aa 


is a decreasing function of u on (0, oo). We divide our following discussion into two cases: 


(i) (0) <1 and (ii) (0) > 1. 
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Consider case (i) first. Let 
v(r) =ru,(r) + u(r), 
where & is a positive constant to be specified later. Then 
—Av— pf (uv = p[2 fu) —€(f’Wu- fw)] 
= uf w[2-& (Kw —1)]. (4.6) 
Define 


_ru(r) 


A(r)= Toe 


r €[0, 1). 


Clearly (0) = 0 and h(1) = +00. We show in the following that h’(r) > 0 in (0, 1). 
Indeed, 


2 = 
ee rus + (N Prt + prf (uu = 2H(r) euro . (4.7) 
where 
2 =! 
Be rus +(N —2)u;u 7 prF(u(r)), 


2 


Fw= | f(s) ds, Qlu) =uf(u) —2Fu). 


Here and in what follows, u,; is sometimes used for uv’ to avoid notation like uv’ = 
If N = 1, 2, then it follows from the first equality in (4.7) that h’(r) > 0 in (0, 1). There- 
fore, we need only consider N > 2. A simple calculation gives 


[PX Ary] = urX'G(ur)) with Gw) = NF) — “rw. 


Clearly, G(O) = 0 and 


Gu) = AF fo) feu 
_yclectin N+ 2)u — (N= 2) 


2 


It follows that 


G’(u) <0 on[0,y), G'(u)>0 on (y, 00), 
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where y = (N — 2)/(N + 2). Therefore, we have either G(u) < 0 on (0, co) or G(u) < 0 
on (0, yo) and G(u) > 0 on (y, 00) for some yo > y. We show that actually only the latter 
alternative can occur. Indeed, if G(u(r)) <0 for all r € [0, 1], then 


ur (1) 
2 


1 
0< =Hay=| ur! G(u(r)) dr <0. 
0 


This contradiction shows yo exists, and moreover, 
u(0) > yo (4.8) 


whenever N > 2 and u is a positive solution of (4.4) with 2 = B. 
Let t be uniquely determined by u(t) = yo. We have 


[rN Ary] = ur 'G(ur)) > 0 Wr e O02), 
which implies H(r) > 0 for r € (0, t]. Moreover, for r € (¢, 1], G(u(r)) < 0 and therefore 


1 
Hy = Ha) f ur~'G(u(r)) dr 


r 


>H(1)= 


ur) 9 
5 


Thus we always have H(r) > 0 on (0, I]. 
Since Q(0) = 0 and 


O'(u) =uf' (u) — flu) = fw [KW —- 1] >0 VWue([0, 1), 


we have Q(u) > 0 on [0, 1) and hence, by (4.7), h’(r) > 0 on (0, 1), as required. 
Denote 


2 


WO Gear 


Then ;2(r) is strictly decreasing for r € (0, 1], and by (4.6), 


—Av-pf'uv=gr), gir) =ufw[K Ww) — 1][u(r) - €]. 


With these preparations, we are now ready to show that ¢@ does not change sign in B in 
case (1). We argue indirectly. Suppose ¢(r) has a zero in (0, 1). Then we can findO <t < 
t2 < 1 such that 


b(t) =9, o(r)>0 Wre[0,t), 
b(t2) =90, or) #0 Vre (th, 1). 
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Now we choose € = h(t,) in v = ru; + &u, and have two subcases to consider 


(a) M(t) 2§ and (b) u(y) <é. 
We have 


v(r) =ru, +h(t))u= u[h(t,) _ h(r)] >v(t;)=0 Vr e[0,t,), 
vir) <0 Vre(t, 1). 


(4.9) 


In subcase (a), we easily see g(r) > 0 on (0, 7), and hence, using v(t)) = 0, we arrive 
at the following contradiction 


t 
OF i “8@)bO) "A dr = i [-Av—uf'w]o= i v =0, (4.10) 
0 B a 


1 Bi 
where we use B, = {x € R®: |x| <r}. 
In subcase (b), we may assume ¢(r) > 0 on (f, 1) for otherwise we can replace ¢ 


by —@. Moreover, one easily sees g(r) < 0 on [f1, 1]. Then by (4.9) and ¢’(t2) > 0 > #’(1), 
we also arrive at a contradiction 


1 
o> [ g(r)do(r)r® | dr 


t 


=| [-av-uf'wrlo 
B\B,, 


= —vd, +f vibes 0. (4.11) 
dBi aB 


This proves the lemma for case (i). 


Next we consider case (ii) where u(0) > 1. We can find 0 <r; <2 < 1 uniquely deter- 
mined by 


u(r}) = 1, u(r2) = 1/4. 


We first show $(r) 40 on (0, 71]. To this end, we choose w(r) = u(r) — 1/4 as a test 
function. Clearly 


—Aw-—uf'(uw=pqtu), qu)=fu)— fu)u-—1/4). 
We have 


q (u) = (1/4 —u) f" wu), 
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which is positive on (0, 1/4), negative on (1/4, 1/2) and positive on (1/2, 00). Since 
q(0) = 1/4,f’(0) =0, it follows 


q(u) > q(1/2) = fU/2) — 1/4f"(1/2) =0 Vu > 0. 
Hence 
—Aw —uf'(ww=pqtu) >0 onB. 
If @(r) has a zero in (0, 71], then we can find t € (0, 71] such that @(r) > 0 on [0, t) and 


o(t) = 0. Using w(t) = u(t) — 1/4 > u(r2) — 1/4 = 0, we deduce 


t 
0< [ua unjooyr’tar= f [-aw-nf'wulo= f wo, <0. 
0 


t t 


This contradiction finishes our proof for ¢(r) 40 on [0,71]. 
Next we suppose ¢(r) changes sign in (0, 1) and deduce a contradiction. Since ¢(r) 4 0 
in [0,71], we can find r; < ft, < t2 < 1 such that 


p(t) =9, o(r)>0 Wre[0,t), 
b(t2) =90, or) #0 Vre (th, 1). 


We now define u(r), h(r), u(r) and g(r) as in case (1), and choose € = A(t,) in the 
definition of v(r). Since u(r) < 1 on [71, 1], our arguments in case (i) give 


h'(r)>0 on (ry, 1). 
Hence 
vir) = u[h(t) —h(r)] >ov(tj)=0 Vre[r, ty), vir) <O VYre (ty, 1). 


If w(t1) > &, then since (vr) is strictly decreasing on (0, 1) and K (u(r)) < 1 on [0,71), 
K(u(r)) > 1 on (74, 1], we have 


g(r) =uf(w)[K(u) —1][u(r) -€] > 0 Vre(n.t) 
and 
g(r) =f (u)[2 —€(K(u) —1)] >0 Vr e[0,ri]. 


Thus g(r) > 0 on [0, t;). Now we can deduce the same contradiction (4.10) as in case (1). 
If w(t) < &, then 


g(r) =f w)[K(u) —1][u~)-€] <0 Yrem, 1, 


Bifurcation and related topics 177 


and we arrive at the contradiction (4.11) as in case (i). This finishes the proof of 
Lemma 4.2. 


Using Lemma 4.2 and the turning point theorem of Crandall and Rabinowitz 
[CR1,CR2], Theorem 1.3, we can prove the following result. 


LEMMA 4.3. Suppose that ug is a degenerate positive solution of (4.4) with 2 = B and 
| = Wo. Then all the positive solutions (1, u) of (4.4) that are near ({10, uo) in R! x C(B) 
lie on a smooth curve represented by 


(uu, u) = (10 + t(s), ug +560 + z(s)) with |s| small, 


where z(0) = z'(0) = 0, t(0) = t’/(0) = 0 and ¢ is a positive eigenfunction given in 
Lemma 4.2. Moreover, t" (0) > 0. 


PROOF. Set X = Cj°(B), Y = C%(B) and F(u,u) = Au + puf (u). It is easy to see that 
F is a smooth mapping from R! x X to Y. The partial derivative F,, at (19, uo) is given 
by Fy (0, u0)d = Ad + of’ (uo). By Lemma 4.2 we know that N(F,,(40, uo)) is of 
one dimension: in fact, N(F, (440, uo)) = span{¢o}. Moreover, codim F,, (40, uo) = 1 by 
the Fredholm alternative. Also 


F (Wo, uo) = f (uo) ¢ R(Fu (io, uo)) 
since 3 S Uo)do > 0. Therefore we can use Theorem 1.3 to conclude the following: 


Near the degenerate solution ({19, Uo) in IR! x X, the solutions of (4.4) form a smooth 
curve 


(u(s), u(s)) = (uo + t(s), uo + 80 + 2(5)), (4.12) 


where s — (t(s),z(s)) € R! x Z is a smooth function near s = 0 with t(0) = 
t'(0) =0, z(0) = z'(0) =0, where Z is a complement of span{¢o} in X. 


By a standard elliptic regularity consideration, we know that any solution of (4.4) near 
(40, Uo) in R! x C(B) is also close to (49, Uo) in R! x X. Therefore all the positive 
solutions of (4.4) near (49, uo) in R!'xc (B) are contained in the smooth curve (4.12). 

We now substitute the expression (4.12) for the solutions into equation (4.4), differenti- 
ate the equation with respect to s twice at s = 0, multiply the resulting identity by @ and 
integrate it over B to obtain 


Io f"(uo) Gar" ar 
0 ; 
I f (uo)dor’—! dr 


t"(O)= (4.13) 


It remains to show that t’”(0) > 0. Let use define 


E(r) = wor’ '[ f(uo)o) — Ff (uo) doug]. 
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One easily checks that 


g(r)= —por—! f"(uo)do(uo) §(0) = (1) =0. (4.14) 


It follows that 
; 2 
/ f" (uo)¢o0(ug) rX | dr =0. 
0 


We claim that f”(uo(r)) changes sign exactly once in (0, 1). Otherwise we necessarily 
have uo(0) < 1/2 and f”(uo(r)) > 0 in (0, 1). By the first part of (4.14), this implies that 
E’(r) < 0 in (0, 1), and hence &(0) > &(1), contradicting the second part of (4.14). This 
proves our claim. Let us assume that f”(uo(r)) changes sign exactly once in (0,1) at 
rT; 

Next we show that —Up and @o intersect exactly once in (0,1). Since —up(0) = 0, 
—up(1) > 0, ¢0(0) > 0 and go(1) = 0, —up and ¢o intersect at least once in (0, 1). If 
they intersect at least twice, we may assume that there exist 0 < rj < rz < 1 such that 
(fo + up) (11) = (Go +u5)(r2) = 0, and (¢9 + up) (7) < 0 for r € (71, rz). This in particular 
implies that (fo + 45) (r1) <0 and (¢9 + ug)’ (r2) > 0. By the equations of ¢ and u4, it is 
easy to check that the following identity holds: 


[ry U9 d5 — 7%! doug] = -(W - Dr® updo. (4.15) 
Integrating (4.15) from r; to r2, and using (0 + u9)(r1) = (bo + Up) (72) = 0, we obtain 
r) uo (r2)(o + uo) (r2) — rl up) (bo + uo) 1) 


12 
= -{ (N — 1)r8 ub dodr. (4.16) 
ry 
However, the right-hand side of (4.16) is positive since Up <0 and ¢o > 0, while the left- 
hand side of (4.16) is nonpositive due to the facts summarized ahead of (4.15). This contra- 
diction shows that —Up and ¢o intersect exactly once in (0, 1). By replacing ¢p by no¢o for 


some suitable positive no if necessary, we may assume that —uo and ¢o intersect exactly 
at r=7, where f” (ug(r)) changes sign. It now follows that 


f"(uo)d6 < f"(uouy in 0,7) UG, 1). 


Hence 


1 1 
i; f" (uogarn! are / Ff" (uo)o(up) rN! dr =0. 
0 0 


Since i f(uo)dor®—! dr > 0, the fact that r”(0) > 0 now follows from (4.13). 


Before proving our main result for (4.4), we need one more preparation. 
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LEMMA 4.4. Suppose g € C!(R!) and B is the unit ball in RN , N > 1. Then for any given 
c > 0, the problem 


—Au=Agtu), ulag =, 
can have at most one solution (A, u) satisfying 1 > 0,u >0 and u(0) =c. 
PROOF. Suppose that (Ao, uo) is such a solution. It suffices to show that any other such 


solution (A, u) must coincide with (Ao, uo). By Gidas, Ni and Nirenberg [GNN], both 
u and uo are radially symmetric. It is readily checked that v(r) = u((Ag/a)!/2r) satisfies 


(rX~'v')' + orN~'g(v) =0, v0) =, v'(0) =0. 


Since ug satisfies the above equation with the same initial values, by uniqueness of so- 
lutions to the above initial value problem (see, for example, [NN], Proposition 2.35), we 
deduce v = uo. In particular, v(r) > 0 for r € [0, 1) and v(1) = 0. This implies that A = Ao 
and hence u = v = ug. This finishes the proof. 


We are now ready to prove the main result of this subsection. 


THEOREM 4.5. Suppose 82 = B. Then there exists [49 > 0 such that (4.4) has no positive 
solution for [L < [Lo, has exactly one positive solution for 4 = [to and exactly two pos- 
itive solutions for 4 > (to. Moreover, the positive solution set {(u,v)} of (4.4) forms a 
“C”-shaped smooth curve in the space R! x C(B). Furthermore, if we denote the upper 
and lower branches by 


{(u, v0"): mo <p <oco} and {(u, vp): Ho <M < ov}, 


respectively, then 4 — v(x) is strictly increasing for any fixed |x| < 1, u > v,(0) is 
strictly decreasing, and 


lim v4(x)=00 Y|x| <1, 
[> 0o 


lim v,(0)=&, €=0 ifN=1,2 and E>0 ifN>2. 
p> co 


PROOF. We first show that for yu large, (4.4) has at least one positive solution. Let ¢ € 
Ch°(B) satisfy @ > 0 and maxg¢ = 1. Let v be the unique solution of Av + ¢ = 0, 
vlap = 0; let v be the unique solution of Av + 4 =0, v|ag = 0. It is easy to check that for 
all large «4, v > v and they are upper and lower solutions to (4.4), respectively. Therefore 
there exists 4; > 0 such that (4.4) has at least one positive solution provided that > [11. 
Now we can set 


Lo= inf{ > 0: (4.4) has a positive solution}. 
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We claim that (1p > 0. If not, there exists 4; — 0 and v; such that Av; + pe !/%i = 0. Set 
Vj = U;/||V; loo. Then 


- el /vi 
AU; + Mi 


—v,=0, vlas=0. 


l 


As e~!/% /v; is uniformly bounded, by standard elliptic regularity, ||; || y2» — 0. The 
Sobolev embedding theorem implies that v; > 0 uniformly. However, this is impossible as 
lV loo = 1. This contradiction implies that jo > 0. 

Again by standard elliptic regularity, we can further show that (4.4) with = wo has 
at least one positive solution, and we choose one of them and denote it as vg. We claim 
that vo must be a degenerate solution. If not, then by the implicit function theorem we 
can show that for jz less than but close to jg, (4.4) has at least one positive solution, and 
this contradicts the definition of jzo. Since vo is degenerate, our Lemma 4.3 implies that the 
solutions near ({49, vo) form a smooth curve which turns to the right in the (Z, v) space. We 
may denote the upper and lower branches by v” and v, respectively, where v (0) > v,, (0). 
As long as (2, v“) and (jz, vz) are nondegenerate, the implicit function theorem ensures 
that we can continue to extend these two branches in the direction of increasing jz, and 
we still denote the extensions as v“ and v,,. This process of continuation towards larger 
values of yw for both branches may be stopped at some finite .* by one of the following 
three possibilities: 

(i) |]v"* |loo OF ||Up4 Iloo goes to infinity for some py, > u* — 0; 

(ii) ||u“"|loo OF ||Up, lloo goes to 0 for some fz, > p* — 0 (note that by the Harnack 
inequality, v“ and v, can only lose positivity through vanishing on the entire domain); 

(iii) v™ or V,,, 18 a degenerate solution. 

However, (i) cannot occur since v" and v,,, are uniformly bounded by L? estimates 
and Sobolev embedding theorem; (ii) cannot occur either as otherwise, denoting v, = v 
OF Van» 


ew! /tn 


0-08 (-1 Joao. 


Un 


Finally, (iii) cannot occur. This is because, if, say, (uw, v“) becomes degenerate at jz = u*, 
then Lemma 4.3 tells us that all the solutions near (u*, yh") must lie to the right-hand 
side of it, which is a contradiction. Therefore we can always extend these two branches of 
solutions to 4 = oo. 

By Lemma 4.4, we see that ~ — v(0) and 4 — v,,(0) must be strictly monotone and 
v¥ (0) > vo(0) > v, (0) for any we € (Wo, OO). Hence 


eu vp) =€ € [0, vo(0)), Pils v'iO=nE (v0 (0), oo]. 


Let us first show that 7 = oo. In fact we show a little more than that. Let us denote 
Wy = Dv". By Lemma 4.3, we find that for 4 > jo but close to 0, wy, > 0 in B. 
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Define u* := sup{u > Wo: wy > Oin B for all yw’ € (0, “)}. We show that * = oo. 
Differentiate the equation for v“ with respect to jz, we find that 


—Awz, = uf (v")wi+ f(v") > uf’ (v“)w, Yxe B, wylap =0. 


Therefore w, >, #0 for pw € (uo, u*] and by applying the strong maximum principle 
to the above differential inequality with 4 = *, we deduce w,« > 0 in B, w’ ur (1) <0. 
Since 4 > wy, is continuous in the C 2(B) norm, the above conclusion for wat a ae 
that w,, > 0 in B for all u > «* but close to yx*, a contradiction to the definition of j1*. 
Therefore w,, > 0 in B for all 2 > ro. This implies that ~ — v/(r) is strictly increasing 
and v“(r) > vo(r). It follows that 


vir) = (—A) | [pe] > 2 ay! [woe] =  v0(r) + 00 
Ho Mo 


as  —> oo, for any r € [0, 1). 

We next show that € > 0 when N > 2 and € = 0 when N = 1,2. By Lemma 4.4, this 
would imply that all the positive solutions of (4.4) are contained in these two solution 
branches if we can show that there is no positive solution of (4.4) satisfying u(0) < € when 
E>0. 

Let us note that when N > 2, € > 0 is a consequence of (4.8) in the proof of Lemma 4.2. 
When WN = 2, we argue indirectly. Suppose that € > 0. Consider the initial value problem 


(rz')'=-re', 20) =£, 7/0) = 


It is easily seen that z’(r) < 0 for r € (0, ro) as long as z is positive on (0, ro). If z remains 
positive on [0, 00), then z(x) = z(|x|) = z(r) satisfies Az = —e~!/ < 0 on R? and hence 
is a bounded subharmonic function on R2. It is well known that in such a case, z = const. 
Clearly this is impossible. Hence z has a first zero ro > 0: z(r) > 0 in [0, ro) and z(7o) = 
By continuous dependence of the solutions on the initial values, for z* large, the unique 
solution z* of the initial value problem 


(rz) =-re", 20) = v,+(0), 7) = 


has a first zero r* close to rp. But then v*(r) = z*(r*r) is a solution of (4.4) with v* (0) = 
vp* (0) but p= (r*)?* > te # w™ as u* — ovo. This contradicts Lemma 4.4. Hence we 
must have € = 0. 

When WN = 1, the proof is similar but simpler. The initial value problem now is changed 
to 


z’=—ze'/%, 20) =&,z/(0) = 
and the existence of a first zero of z follows from z” < 0 on [0, oo). 


Finally we show that if € > 0, then (4.4) has no positive solution with u(0) < é. In 
fact, if there is such a solution, then the argument we used above can be repeated to show 
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that there is a second smooth curve {(j2,)} of positive solutions which is “C”’-shaped 
and for (4, V) on its upper branch, v(0) > oo as 4 > oo. But this implies that for any 
large number C > 0, there are at least two solutions v“ and v with v“(0O) = v(0) =C, 
contradicting Lemma 4.4. The proof of Theorem 4.5 is complete. 


4.2. The perturbed Gelfand equation in dimensions I and 2 


We will show that when (2 = B in dimensions | and 2, the positive solutions of the 
perturbed Gelfand equation are completely determined by (4.4). We use the equivalent 
form (4.3), namely 


—Au=pe'/&+) in B,  ulag =O, (4.17) 


where B = {x € R™: |x| <1}, N=1,2. 

Let us first observe the following simple relationship between (4.17) and (4.4). 

If (uw, v) is a positive solution of (4.4) with (2 = B, and v(O) > e, then we can find a 
unique a € (0, 1) such that uv(a) = e. Define 


u(x) =v(ax)—e, xeEB. 
Clearly 
—Au=a°uf(ute), ulep =0. 


That is, (a7, u) is a positive solution of (4.17). In dimensions 1 and 2, since € = 0 in 
Theorem 4.5, we find that for any ¢ > 0, we can obtain a positive solution of (4.17) from 
a positive solution of (4.4) through the above process. Moreover, by Lemma 4.4, we easily 
see that all the positive solutions of (4.17) can be obtained in this way. Therefore, the 
positive solutions of (4.17) are completely determined by (4.4). 

The following result, for N = 1,2, is the counterpart of Lemma 4.2, but we will see in 
Remark 4.9 that this result is not true when 3 < N < 9. This indicates that, in this kind of 
conclusions, the nonlinearity and the space dimension play a very subtle role. 


LEMMA 4.6. [fu is a degenerate positive solution of (4.17) and @ is anontrivial solution 
to 


—Ad=uf;U)¢, dlan=9, 
then ¢ does not change sign in B. 


PROOF. Before starting the proof, let us remark that our proof only requires ¢ > 0. There- 
fore, it is a simplification of the proof of Lemma 4.2 for the case N = 1, 2. 
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By Gidas, Ni and Nirenberg [GNN], u is radially symmetric: u(x) = u(r),r = |x|; 


moreover, u'(r) <0 on (0, 1]. By Proposition 3.3 of [LN], ¢ is also radially symmetric, 


d(x) = d(r). Hence 
” i ae ! / : / 
e+ re +puf,u)o=0 in[0,1], ¢(@)=0,¢(01)=09. 


We may assume (0) > 0. 
We make use of the test function 


vir) =rul(r) +€ 
instead of the usual v = ru’ + &u as used in the proof of Lemma 4.2, where & is a posi- 


tive constant to be specified later. This choice of test function seems crucial. By a direct 
calculation, 


N-1 
w+ ——v' + wf wv = wlEfW) — 2 fe] = G0), 
[rl (u'g — ug’) = G@ryrN—!, (4.18) 


where 


Gi) =nfe, = TP? 


Clearly, g(r) is strictly increasing in r. 

Now we suppose ¢(r) changes sign in (0, 1), and want to deduce a contradiction from 
this. Let rg € (0, 1) be the first zero of ¢(r): d(7o) = 0 and g(r) > 0 for r € [0, 79). We 
choose € = —rou'(ro) inv =ru’ + &. Since 


v= —rpfelu) + (2—N)u' <0 Vre(O, 1], 


we have u(r) > v(79o) = 0 on [0, ro) and v(r) <0 on (79, 1]. 
We divide our considerations below into two cases: 


(i) g(70) <0 and (ii) g(ro) > 0. 


In case (i), using g(r) < g(7o) < 0 on [0, 70), we obtain the following contradiction by 
integrating (4.18) from 0 to ro: 


0> ie Grr! 6dr =[r%~"(v'o — v6’) ||) =0. 
0 


In case (ii), we consider the last zero of @(r) before r = 1: ro <r? < 1, d(r°) =0, 
o(r) 40 forre (r9, 1). We may assume that ¢(r) > 0 on (r°, 1) (otherwise change the 
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sign of @). Then ¢'(r°) > 0> ¢'(1). Now using g(r) > 0 and v(r) <0 on [r°, 1], we again 
deduce a contradiction: 


1 
0< is G(r)rN-'o(r) dr =[r%~(u'o — v6’) ] | 0 <0. 


The proof is complete. 
Using Lemma 4.6, we obtain a variant of Lemma 4.3, whose obvious proof we omit. 


LEMMA 4.7. Suppose that ug is a degenerate positive solution of (4.17) with « = bo. 
Then all positive solutions (1, u) of (4.17) that are near (19, uo) in R x C(B) lie on a 
smooth curve represented by 


(uu, u) = (10 + 1(s),ug+so+ z(s)) with s small, 


where z(0) = z'(0) = 0, t(0) = t’(0) = 0 and ¢ is the positive eigenfunction given in 
Lemma 4.6. Moreover, 


Sg fe (uo)? dx 
HOT fe(unybdx | 


t"(0) = (4.19) 


We are now ready to prove the main result of this subsection. 


THEOREM 4.8. For all sufficiently small ¢ > 0, the positive solution curve {(L,u)} 
of (4.17) is exactly S-shaped. There exist 3 and Aj satisfying lime+oA; = [0, 
limg_,9 A = 00, such that (4.17) has 
(i) a unique positive solution for jc € (0, A3) U (Az, 00); 
(ii) exactly two positive solutions for 4 = 0% and = Af; 
(iii) exactly three positive solutions for ju € (Az, Az). 


PROOF. By Theorem 4.5, the positive solution curve of (4.4) with 2 = B is “C”-shaped 
with exactly one turning point at (440, vo), where v9 = Vy, = v4“. Denote & = v9 (0). Then 
for any ¢ € (0, 9), we can find a unique We € ({40, C©) such that 


vps (0) = €. 
By Theorem 4.5, we see that jz, increases as € decreases and us > Case > 0. 
For any . €[0, We), we can find a unique a,, = a,,(€) € (0, 1) such that 
Vy (Ay) = €. 
Clearly, 


lim ay (e)=1 for fixed 4 > Mo, 
oF 


: (4.20) 
lim ay(é)=0 for fixed e € (0, go). 
UH Ue—O 
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Now we define 
Nu = (Ay), Up (X) =Vy(Ayx)—e, x EB, 
and find that 
P= {ip tae BO Se < ee} 
gives a piece of smooth solution curve to (4.17). Moreover, I, connects (7ji9,Ujyo) and 
(0, 0) (when pp > fee — 0). 
On the other hand, due to ¢ € (0, &), for any 4 > fo, we can find a unique a” = a"(e) € 
(0, 1) satisfying v“(a") = e, and define 
nt = (a")"u, uh) =i" (a"x) —e, xeB, 
we obtain another piece of smooth solution curve of (4.17) 
Re {(n", ul): Lo <p< oo}. 
By Theorem 4.5, 4p — a” is strictly increasing and 


lim a” =1. (4.21) 


p> co 


Therefore 4 > n* is strictly increasing and {(1, u(O)): (uw, u) € I*} is a monotone curve 
in R? that connects (7°, u9(0)) to (00, 00). Since 


(a? u*) = (Nu: Ujig)s 
we find that 
r(e)=I° ul, 
gives a piecewise smooth (in fact smooth) curve for (4.17) connecting (0, 0) and (00, 00). 
By Lemma 4.4, we know it contains all the positive solutions of (4.17). We are going to 
find out the shape of this curve. 
Recall that 
f"@W>0 foruwe(0,1/2) and f"(u) <0 foru€(1/2,0). 
We fix some & € (0, 1/2) and suppose 


e<e€,<1/2-&. 


Then clearly f”(u + €) > 0 for u € (0, &). 


186 Y. Du 
Now we choose Az, > 40 such that 
vy(0) <&| when p > r¢,. 


By shrinking ¢; we may assume that A¢, < fe for all € € (0, €}). We can now divide I’, 
into two parts 


Pe = {(nys Vp): Age Se < me} and TP = {(np, vp): Mo SW < Ag}. 
We first analyze the shape of ri, Define 


AL = “Sup. “his 
Me[Ag, Me) 


By (4.20), one easily sees that there exists ¢2 € (0, €;] such that when ¢ € (0, €2), 


A® is achieved at some [ly € (Ag,, We) and lim A= oo 
E> 


By the implicit function theorem, (7,,,,Uj,) must be a degenerate solution of (4.17). Then 
by Lemma 4.7, (4.19) and our choice of &1, the solutions of (4.17) near (,,, Uy) form a 
smooth curve that has a turn to the left. Therefore, we have an upper branch and a lower 
branch of positive solutions starting from this point, and both branches can be continued 
towards smaller values of jz. The lower branch can be continued to reach (0, 0), because 
(a) we cannot meet a degenerate solution in the way of continuation due to Lemma 4.7 and 
u(O) < & on I, uo and (b) the branch goes along I, os For the same reason, the upper branch 
can be continued till it reaches (7,,, , Ua,, ). This implies that I’, ‘! is exactly “D”-shaped. 

Next we analyze the shape of re It is more convenient for our discussion if we consider 
a bigger piece of solution curve 


re=TZU{(n*.u*): wo <a < Ag}, 
which contains part of ’*. We observe that any (4, u) € r3 satisfies 

re SM She, Uy_, 0) — € < llllloo =u) <u" (0) — &, (4.22) 
where 

ax =inf{u: (u,u) € 13}. 


Since n“ is increasing in 2, A* is achieved at some n,,’, u’ € [Wo, Ag, ). Therefore (AZ, uy,’) 
must be a degenerate solution of (4.17). Clearly 


2 
AE < myo = (Ayo (€))’ Ho < Ho. 
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On the other hand, it is easy to see that a,,(€) > 1 as e — 0 uniformly for yw € [09, Ag, J. 
Hence 


lim 47 = lim min{ (a, (e))u: Mo <M < Az, } = wo. 


e>0 


We know from the above that Fr? contains at least one degenerate solution (Az, u,,). If 
we can show that there exists ¢3 € (0, €2) such that whenever ¢ € (0, €3), any degenerate 
solution on I~. e must make 1’’(0) > 0 in (4.19) of Lemma 4.7, then a continuation argument 
much as before shows [3 contains exactly one degenerate solution at jz = 4* and the curve 
makes a turn to the right at this point. Hence i must be smooth and “c’’-shaped. This 
tells us that the entire solution curve I"(€) is exactly S-shaped with two turning points at 
fe = X% and yu = AZ, respectively. Clearly, this would finish the proof of Theorem 4.8. 

It remains to show that there exists ¢3 € (0, €2) such that any degenerate solution on I, 2 
must make 1” (0) > 0 in (4.19) of Lemma 4.7 as long as € € (0, €3). We argue indirectly. 
Suppose for some ¢, — 0, we can find degenerate solutions (u*, u*) € I, : such that 


itp fuk + exp dx 
Sp FUE + ex)dedx ~ 


7 (0) = 


where ¢,; is the positive eigenfunction given in Lemma 4.7 when (ju, uv) = (uk Ju). We 
may assume that ||@¢|lo0 = 1. 

By (4.22), we may assume that uk > pe € [“o, Ag, ]. Equation (4.22) also implies that 
lf (uk + ex)|loo is uniformly bounded. Therefore, by the equation for u* and a standard 
regularity and compactness argument, {u“} has a convergent subsequence in C!. We may 


assume u* —> v9 in C!. Moreover, from 


—Agg = uk f' (uk + ex)bx,  drlag =, 


we can use a similar regularity and compactness argument to obtain a C! convergent sub- 
sequence of @y. We may assume ¢; — °. Then we easily deduce 


—Av® =p f(u°), u|,,=0,u° >0,u° £0, 
and 


Ag =p f'(u) 6°, dlan =0,0° 50, | 6°, = 1. 


This is to say (w°, u°) is a degenerate positive solution of (4.4) and ¢° is the corresponding 
positive eigenfunction. By Theorem 4.5, (4.4) has a unique degenerate positive solution 
which is ({49, Uo), and by Lemma 4.3 and (4.13), 


Sn fF (uoo? dx 
HOT, Fluoodx 


z"(0) = 
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o > [tL 
Az At 


€ € 


Fig. 3. Bifurcation diagram for (4.17) with small ¢ > 0. 


Therefore, we must have ju* > jug, u > uo and ¢° = ¢ (note that the positive eigenfunc- 
tion is unique if it is normalized). Hence we have 


itp fuk + exp dx : Sz f" (uo)g? dx 
Ty Fuk + e)dy dx HOTT fuoyodx 


This contradiction finishes our proof. 


0>7/0)= 


Theorem 4.8 is illustrated by the bifurcation diagram in Figure 3. 


4.3. The perturbed Gelfand equation in higher dimensions 


In this subsection, we consider the perturbed Gelfand equation with space dimension 
N > 3. For such N, by Theorem 4.5, any positive solution (u,v) of (4.4) with 2 = B 
satisfies 


v(0)>é&>0, where &é= at v4, (0). 
—>0o 


We can still use the transformation u(x) = v(ax) — e, where v(a) = €, to obtain a posi- 
tive solution (a? Lu, u) of (4.3) with 2 = B from a positive solution (i, v) of (4.4). More 
precisely, we can define 


(e)=T* UL, re ={(n",u"): wo <p < oo}, 
Te ={(mus up): Lo << co}, 


as in Section 4.2, except that now n,, and u, can be defined for all 4 > fo, since € > 0 
(we assume that € < &). 
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However, unlike in the case N = | and 2, the solution curve I’(¢) does not give all 
the positive solutions of (4.3) with (2 = B, since any (w,u) € I(e) satisfies u(0) > 
& — e, and it is well known (and can be easily shown) that for any fixed ¢ > 0, the entire 
positive solution branch {(j2, u)} of (4.3) with 2 = B has the point (0, 0) on its boundary: 
it approaches (0,0) as yz — 0. Let us note that this implies that ,, remains bounded for 
lL € [Wo, ©). To better understand the entire positive solution branch for (4.3) with 2 = B, 
we need the help from the Gelfand equation (4.2) and some general bifurcation results; we 
will follow the approach in [Dal] and [Du2]. 

We first recall some abstract results. Suppose that 

(H;) X and ¥ are real Banach spaces and F:R?xX>Yisa C*-map (k > 2) which 

sends (¢,A,x) € R? x X to F(e,a, x) EY; 

(H2) »' is a component of the set of solutions (A,x) of F(O,A,x) =0 and Xp is a 

connected compact subset of 2’; 

(H3) For any (A, x) € Xo, Fy (0,A4,x): X — Y is a Fredholm operator of index 0, and 

the mapping 


B(u, h) = F,(0,A, x) + Fr(0,4,x):R'x XY 


is onto; in other words, for any (A, x) € Xo, either 

(i) Fy(O,4,x): X — Y has a continuous inverse, or 

Gi) dim N(F,(0,A,x)) = codim R(F,(0,A,x)) = 1 and F,(0,A,x) ¢ 
R(F, (0,4, x)). 

We want to know how %po is perturbed to give a solution set ’, of F(e, A, x) = 0 when 
€ is small. We start with a local analysis. Suppose (Ao, xo) € Xo. Then either case (i) or 
case (ii) in (H3) happens. If case (i) happens, then it follows from the implicit function 
theorem that there exist a neighborhood V of xo in X and a small number 6 > 0 such that 


F~!(0)M ((-8, 8) x (Ap — 8, Ao +8) x V) 
= {(6,A, x, €)): lel, |A — Aol < 5}, (4.23) 


where (¢, 4) > x(¢, A) is C*, and x(0, Ao) = x0. 
If case (ii) happens, then by Theorem 1.3 and its proof (see [CR2]), there exist a small 
neighborhood W of (Ao, xg) and a small 6 > O such that 


F—'()N ((-6, 8) x W) = {(e, A(s, €), x(s, €)): 5, € € (—6, 4)}, (4.24) 


where A(s,¢€) and x(s,¢) are Ck with A(0,0) = Ao, As (0,0) = 0, x(s,€) = x0 + sug + 
z(s,€), T(0,0) = t;(0,0) = 0. Here up spans N(F;.(0, Ao, X0)) and z(s, €) belongs to a 
complement Z of span{uo} in X. 

Since Xp is compact, by a finite covering argument, we find from the above discussion 
that Xp is a C¥ curve and for any small ¢, the solutions of F(¢,A,x) =0 near Xo form 
a C* curve de; see [Dal], Theorem 2, and [DLol1], Proposition A.2, for more details. If 
we change C* to “analytic” in (Hj), then we can do the same in all the conclusions in the 
above discussions. 
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Let us now see how the above discussions can be applied to (4.3). Set X = ce (B), 
Y= C“(B) and F(e,u,u) = Au + wf-(u). Then from the proofs of Lemma 4.3 and 
Theorem 4.5 we know that the conditions (H;)-(H3) are satisfied for positive 4 and é 
if we choose 2 to be any connected compact part of the global positive solution curve 
{(, u)} of (4.3) with 22 = B. Moreover, if we choose 2 to contain the unique turning 
point (0, uo), then due to Lemma 4.3, (4.23) and (4.24), we find that for all small ¢ > 0, 
>’, contains exactly one turning point (W,, u,). Moreover, it is easily seen that the upper 
branch in X, contains part of ’* defined through the transformation at the beginning of 
this subsection. As in Section 4.3, we easily see from Theorem 4.5 that 7“ is a strictly 
increasing function. Thus this upper branch can be parameterized by jz and gives a unique 
positive solution for each fixed jz > ,. The lower branch can also be continued, and in 
fact, it can be continued till it reaches (0,0); however, the shape of the lower branch is 
much more difficult to control. Let us note that if we have chosen 2g to be a rather large 
piece of the “c’”’-shaped positive solution curve of (4.4) (with 22 = B), then 2’, with small 
€ > 0 is a large piece of “C’’-shaped positive solution curve of (4.3) (with 22 = B); hence 
the shape of its lower branch is controlled till a very large jw. Let us denote the union of 2’, 
and its well-controlled continued entire upper branch by I;*. Then we know that I is 
exactly “C”’-shaped, its upper branch is unbounded and approaches (00, oo), and its lower 
branch contains points with large but finite jw. 

In order to better understand the rest of the global positive solution curve of (4.3), we 
now use the equivalent form (4.1), which can be viewed as a perturbation of the Gelfand 
equation (4.2). We should note that the curve I for (4.3) is now transformed to a posi- 
tive solution curve Ee = {(A,u): A=p/(e7e!/*), u = v/a”, (u,v) € I} for (4.1) with 
§2 = B, its upper branch is still unbounded, but any (A, uw) belonging to its lower branch 
has 2 small (since A = w/(e7e!/*) and ¢ is small). Let us also note that any (A, u) € pe 
satisfies u(0) > (E — €)/e* > co ase > 0. 

We illustrate [* and * in Figure 4. 

Let us consider the Gelfand equation (4.2) with 82 = B in more detail. When3 < N <9, 
we know from Proposition 4.1 and Figure 2 that its positive solution curve has infinitely 


v(0) u(0) 


A a 


> ft > 
FP for (4.3); N 23 [* for (4.1), N >3 


Fig. 4. Bifurcation diagrams for (4.1) and (4.3) with 2 = B and small ¢ > 0. 
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many turning points. Let us denote them by 7;, k = 1,2,..., where the 7;’s are ordered so 
that when we go from 7p := (0, 0) along the solution curve we meet 7} first, then 7>, 73, 
etc. It is known (see [Dal] and [NS], Section 2) that if (A, uw) lies on the open arc from Tx 
to 7x41, then u is nondegenerate; and if (A, uw) = T, with k > 1, then wu is degenerate and 
the nontrivial solution ¢ to 


—Ag=re"o, blag =9, 


is radially symmetric, @(x) = @(r); moreover, @(r) changes sign over [0, 1) exactly k — 1 
times, and is unique up to a scalar multiple, and 


/ ep dx £0. (4.25) 
B 


These facts imply that if we take X = Co (B), Y = C%(B) and F(e,a,u) = Au+ 
r/e“/U+e | then the conditions (H;)—(H3) are satisfied with 2, ¢ > 0. Moreover, case (ii) 
in (H3) occurs exactly when (A, uv) € {7x: k > 1}. By (4.24) and (4.25), we deduce that 
Tss(0,0) AO when (A, uv) = Tk, k > 1. Hence we can apply the above abstract results to 
conclude the following: 

Let 3g be a connected compact part of the positive solution curve {(A, u)} of (4.2) with 
§2 = B, and suppose that Xo contains the turning points T\,...,T,. Then for all small 
€ > 0, the positive solution curve of (4.1) with 2 = B has apart 2’, which is close to Xo 
and contains exactly k turning points T/,...,T, where T > T; as ¢ — 0, for each 
i=1,...,k. 

Close to Ty = (0,0), we can apply the implicity function theorem to (4.1) to conclude 
that there is a unique positive solution for each 4 > 0 small. Therefore we can extend 2, 
towards (0, 0) so that 7p is an end point of 2’,, provided that 29 has been chosen properly. 


REMARK 4.9. Itis easy to show that, at 7;,2 <i <k, the linearized problem of (4.1) (with 
92 = B and small ¢ > 0) has a radially symmetric nontrivial solution @ which changes sign 
exactly i — | times over [0, 1). Hence Lemma 4.6 does not hold when3 < N <9. 


If N > 10, then it is known (see [Dal]) that the positive solution curve of (4.2) with 
§2 = B contains no turning point and all the positive solutions are nondegenerate. There- 
fore a similar consideration to the above yields the following conclusion: 

Given any connected compact part Xo of the positive solution curve {(A, u)} of (4.2) 
with Q = B, for all small e > 0, the positive solution curve of (4.1) with 2 = B has 
a part &,, which is close to X'q and contains no turning points. Moreover, X’, can be 
extended to reach (0,0) and the extended %’, still does not contain any turning point. 

Combined with F;, we can now illustrate the well-understood parts of the positive solu- 
tion curve of (4.1) in Figure 5. 

The missing part of the positive solution curve for (4.1) can be further described by 
using the bifurcation curve Sp := {(A, u'(1))} of (4.2) with 2 = B; this curve is completely 
understood in [JL], and Dancer [Dal] used So to show that the missing part is roughly the 
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Fig. 5. Bifurcation diagrams for (4.1) with 2 = B and small ¢ > 0. 


bottom part in Figure 5 reflected about the horizontal line passing through the top point 
of the bottom part. However, on this reflected part, the exact number of turning points is 
not known. We refer to [Dal], Figure 1, and [Du2], Figure 4, for bifurcation diagrams 
illustrating the entire positive solution curve. 


4.4. Further remarks and related results 


The above results for the perturbed Gelfand equation (4.1) with 82 = B can be extended to 
the following more general problem 


—Au=dA(1+ euy"e/OF) lap =0, (4.26) 


where 0 < m < 1; see [Du2] for details. The case m > 1 was also discussed in [Du2], and 
the shape of the global positive solution curve for this case is very different. Equation (4.26) 
arises from combustion theory. 

In catalysis theory, there is an equation closely related to (4.1); under some simple 
changes of variables, it reduces essentially to 


—Au=A(1—eu)Pe/OF&) lap =0, (4.27) 


where p is a nonnegative integer (see, e.g., Aris [Ar], Vol. 1, Chapter 4). Let us note that 
when p = 0, (4.27) reduces to the perturbed Gelfand equation (4.1), and when ¢ = 0, 
(4.27) reduces to the Gelfand equation (4.2). 

For (4.27), it has been conjectured that for any nonnegative integer p, the positive solu- 
tion set {(A, u)} is S-shaped provided ¢ > 0 is small and the dimension N = 1 or 2. The 
conjecture was proved to be true for N = | by Hastings and McLeod [HM]. For N = 2 
and p > 0, the conjecture is proved in [Dal] except for a small A-range (with values close 
to 0); the higher-dimension case was also considered in [Dal]. 
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In a series of papers, Korman, Li, Ouyang and Shi developed various useful techniques 
for proving exact multiplicity results for positive solutions to equations of the form 


—Au=Af(u), ulap =0, 


with several classes of nonlinearities; see [OS 1,0S2] and the references therein. Our argu- 
ments in Section 4.1 basically follow their strategy. See also [Tang] for a more recent result 
along this line. 

The abstract results discussed and used in Section 4.3 was further developed by Shi [S]. 


5. Nodal properties and global bifurcation 


To a large extent, the approach in the previous section relies on the analysis of nodal prop- 
erties of the solutions. In this section, we discuss some other aspects of the nodal properties 
and their applications in bifurcation theory. 

Due to the uniqueness of initial value problems in ODEs, it is well known that the nodal 
properties of the solutions to a Sturm—Liouville problem for a second-order ordinary dif- 
ferential equation do not change when one moves along a global bifurcation branch of the 
solutions. This fact can be used to show that global bifurcation branches bifurcating from 
different eigenvalues do not meet each other and hence yielding multiple existence results; 
see [Ra], Theorem 2.3. This idea has been extended to elliptic partial differential equations 
over various two-dimensional domains with certain symmetries, in particular rectangles, 
by Kielhofer and his collaborators; see [K], Section III.6. In this section we look at two 
examples where nodal properties of solutions are used for systems of elliptic equations; 
here we consider radial solutions over circular domains. Let us note that, even for one- 
dimensional domains (i.e., intervals), the analysis of the nodal properties for systems is not 
trivial. It is an interesting problem to see how the techniques in [K] for equations over two- 
dimensional domains such as rectangles can be extended to systems (see [HK] for some 
efforts in this direction). Likewise, the techniques of our Section 4 may have applications 
to radial solutions for elliptic systems. 

Our first example examines a competition system and is taken from Nakashima [N]; our 
second example studies a predator-prey system and follows Dancer, Lopez-Gomez and 
Ortega [DLO]. 


5.1. Global bifurcation of the competition system 


We consider the competition system with constant coefficients and Neumann boundary 
conditions 
—Au=hu(a—u-— pv), 
—Av=hdv(y —v—6du), (5.1) 
dpulag = dyvlag =0, 
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where {2 is either a ball or an annulus: 2 = {xe RY: Ro < |x| < Ri}, O< Ro < Ri, 
N > 1. We assume throughout this subsection that the positive coefficients satisfy 


mee (5.2) 
Y 


This implies that for any A > 0, the two semitrivial solutions (@, 0) and (0, y) are linearly 
stable, and (5.1) has a unique constant positive solution 


Curio hy Oe BOSH ¥ 
C = (GFF). 


which is linearly unstable. We are interested in the existence of other positive solutions 
of (5.1). We will make use of the nodal properties of radially symmetric positive solutions 
and global bifurcation theory to address this problem. 


LEMMA 5.1. Suppose that (u(x), v(x)) = (u(r), v(r)) is a radial, nonconstant positive 
solution of (5.1), and v'(r) > 0 for r € (rx, r*) C (Ro, Ri), and u'(r,), u’ (r*) <0. Then 
u'(r) <0 in (rx, r*). 

Similarly, if v'(r) < Oforr € (rx, r*) C (Ro, R1), and u' (rx), u'(r*) > 0. Then u’(r) > 0 
in (rx, r*). 


Note that the roles of u and v in this lemma can be interchanged. 


PROOF OF LEMMA 5.1. We only consider the first case; the proof for the second is paral- 
lel. Denote f(u, v) =A(a@ — u — Bv) and g(u, v) =A(y — v — bu). We have 


u” + Ny +uf(u,v) =0, 
vl + N—ly’ + vg(u, v) =0, (5.3) 
u’(Ro) = u'(R1) = v'(Ro) = v'(R1) = 0. 


Let @(r) =u'(r)/u(r). We easily find 
! 2 N= 1 
o+¢@ ae MO) =U 


Differentiating this identity we obtain 


-—1 -—1 
oe” + (26 “ho! = («fat v)— “s )o + fy(u, v)v' =0. 


Since f,(u, v) <0, fyo(u, v) < O and v’ > 0 in (ry, r*), we find that, for r € (rx, r*), 


N 


c(r) :=uf,(u, v) — : <0 


r2 
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and 
” N= / 
wy) +(2647 6 +c(r)¢ > 0. 


Since $(r) =u'(r)/u(r) <0 for r € {rx, r*}, by the strong maximum principle (see [PW], 
p. 6, Theorem 3), we deduce either ¢ = 0 or # < 0 in (rx, r*). Clearly, to complete the 
proof of the lemma, it suffices to show that ¢ = 0 on (r,, r*) cannot happen. Arguing in- 
directly, we assume that d = 0 on (rx, r*). Then u’ = 0 on (rx, r*) and by differentiating 
the equation for u in (5.3), we deduce uf, (u, v)v’ = 0 on (r,, r*). This implies that v’ = 0 
on (r,,r*). By the uniqueness of initial value problems for the ordinary differential equa- 
tions of u’ and v’ we deduce that u’ = v’ = 0 on (Ro, Ri), and hence (uw, v) is a constant 
solution, contradicting our assumption. The proof is complete. 


We are now ready to give a good description of the nodal properties of the radial solu- 
tions to (5.1). 


THEOREM 5.2. Suppose that (u(x), v(x)) = (u(r), v(r)) is a radial, nonconstant positive 
solution of (5.1). Then the following hold: 
(i) u(r) and v'(r) have the same number of zeros in (Ro, R), and the number is finite. 
Gi) If Ro = 50 < 81 <-+++ <5m = Ri and Ro =o <t) <-+++ < tm = R\ are the zeros of 
u’ and v', respectively, then for all possible k, 


Sk-1 < th < Ski, th] < Sk < tk41.- 


(iii) The sign of u’ in (sx, Sk41) is Opposite to that of v' in (tg, tkh41), and u" (sp) £0, 


v(t) #0. 


PROOF. For the sake of clarity, we divide the proof into several steps. We assume that 
fu, v) and g(u, v) are as defined in the proof of Lemma 5.1. 


STEP 1. The number of zeros of u' in (Ro, R1) is finite, and the same holds for v’. 


We only prove the conclusion for u’. Suppose for contradiction that wu’ has infi- 
nitely many zeros in (Ro, Ri). Then we can find a limiting point of the zeros, say 
ro € [Ro, R1]. It follows that uw’ (ro) = u" (ro) = 0. From the equation for u we deduce that 
f (u(ro), v(70)) = 0. (This is true even if ro = 0.) We now consider v'(ro). If v’(ro) 4 0, 
then by continuity there exists a small interval 7 having ro as an end point such that 
v'(r) 40 in J and J contains a sequence of zeros of u’ converging to ro, say {rg}. We 
now apply Lemma 5.1 to the interval with end points ro and r, and find that u’ does not 
vanish and has the opposite sign to v’ in this interval; this is a contradiction since infinitely 
many r,’s belong to this interval. 

If v’(ro) = 0 but v’ (ro) 40, then we can find a small interval J as above and deduce 
the same contradiction. The only case left now is v’(r9) = v"(ro) = 0. In such a case, 
from the equation for v we obtain g(u(7o), v(7o)) = 0. Therefore, if we denote (€, 7) = 
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(u(ro), v(ro)), then (u, v) = (&, 7) is a solution to the differential equations in (5.3) with 
initial conditions (u(ro), v(ro)) = (&, 7), (u’ (ro), v'(r9)) = (0, 0). By uniqueness of this 
initial value problem (including the possible singular case r9 = 0 and N > 1), we deduce 
that (u, v) = (&, n) in (Ro, Ri), a contradiction to our assumption. This finishes our proof 
of Step 1. 


STEP 2. If ry < rz < 13 are three consecutive zeros of u’, then u'(r) changes sign as 
r crosses rz; similarly, if ry < r2 < 13 are three consecutive zeros of v', then v'(r) changes 
sign as r crosses r2. 


Again we only prove the first conclusion; the proof for the second is parallel. Suppose 
that u(r) does not change sign at r2. We assume for definiteness that u(r) > 0 on both 
(r1,r2) and (r2,r3). We claim that there exists 5; € (rj, r2) such that v’(s;) < 0. Other- 
wise, we can apply Lemma 5.1 over (r1, 2) to deduce u’ < 0 in (rj, rz). Similarly there 
exists 53 € (r2,1r3) such that v’(s3) < 0. We now claim that there exists 52 € (s;,.53) such 
that v’(s2) > 0; otherwise, we can apply Lemma 5.1 over (s;, 53) to deduce u’ > O over 
(s1, 53), contradicting the assumption that u’(r2) = 0. Let (s,,s*) be the largest interval 
containing s2 in (s;, 53) such that v’ > 0 in (sy, s*) and v’(s,) = v’(s*) = 0. We now apply 
Lemma 5.1 over (s,,.5*), where u’ > 0, and deduce that v’ < 0 in (s,,, s*). This contradic- 
tion shows that u’(r) changes sign at rz. This proves Step 2. 


STEP 3. If Ro = 50 < S81 <--++ < 5m = Ri and Ro = to < th < +--+ <t, = R\ are the zeros 
of u' and v', respectively, then m =n and for all possible k, 


Sk-1 <tk <Sk41,  tk-1 < Sk <Uk+1, 
and the sign of u’ in (sx, 8x41) is opposite to that of v' in (tk, th+1)- 


For definiteness, we assume that u'(r) > 0 over (so, 5,). We show that v’(r) < 0 over 
(to, t1). Suppose for contradiction that v’(r) > 0 in (fo, 1). If 5s; < t%, then we apply 
Lemma 5.1 over (so, 51) and deduce the contradiction that u’(r) < 0 in (so, 51). If s1 > t1, 
then applying Lemma 5.1 over (to, t1) we obtain v’(r) < 0 over (fo, t1), again a contradic- 
tion. Therefore we must have v’ < 0 over (fg, t)). By Step 2 we now have 


(—1)u'(r) > 0 Yr € (sg, Se41); (-1)v'(r) <0 Vre(t.t41). (A) 


We must have s; < fo for if s; > ft then we can apply Lemma 5.1 over (f1, f2) to de- 
duce v’ < 0 on (f}, f2). We can similarly prove that s2 < f3; for otherwise we can apply 
Lemma 5.1 over (f2, £3) C (s1, 52) to deduce v’ > 0 in (fo, 3). Continuing in this fash- 
ion, we can show that s, < t,+, for all possible k, namely k = 1,2,..., min{m,n — 1}. If 
n >m, we already have a contradiction when we take k =m: R, = Sm < tm+1. Hence we 
must haven <m. 

In a similar fashion, we can show that t, < sg41 fork = 1,2,...,min{n,m — 1} and 
m <n. Therefore we must have m = n. This finishes the proof of Step 3. 
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STEP 4. w(sy) £0, v" (te) £0 fork =0,1,...,m. 


We will show that u’(s,) 40; the proof for v’(t,) 4 0 is similar. For definiteness, we 
assume that (5.4) holds. As in the proof of Lemma 5.1, we have, for 6 = u’/u, 


N-1 N-1 
gp’ + (26+ e+ (wfatu.09 = r2 Jo=— fun. (5.5) 


If sk = 59 = Ro, we find from (5.5) and (5.4) that 


i N-1)\., N-1 
g +(264=*) + (ufatus0) = 1 Jo<o Vr € (Ro, ft). 


Since $(r) > 0 in (Ro, 51) and (2@ + (N — 1)/r) + (7 — Ro) fu, v) — (N - 1)/r?) is 
always bounded from below (even if Ro = 0), we can apply Theorem 4 on page 7 of [PW] 
to conclude that ¢’(Ro) > 0, which implies u”(Ro) > 0. If s% = sm = R1, the proof is 
similar. 

Next we consider the case that s, € (Ro, R1). For definiteness we assume that u’ > 0 in 
(sx, Sk+1). If t, = sz, then the proof is similar to the case that s; = Ro. Suppose now ty F sx. 
If tg > sx, then by what is proved in Steps 2 and 3 we must have v’ > 0 in (t,-1, sz], and 
we obtain from (5.5) that 


” N-1 ! N-1 
oy) +(264=*) + (when) - ) Jomo Vr € (tk-1, Sk). 


Since @ < 0 in (sz_1, 5x), we can apply [PW], page 7, Theorem 4, on some (s; — €, sg) to 
obtain ¢' (sz) > 0 and hence u” (sx) > 0. If th < sz, then v’ < 0 in [sg, th41) and 


” N-1 ! N-1 
) + (204 “—*)0 + (uur) -"5*)o<0 Vr € [Sx, th41)- 


Since @ > 0 in (sx, 541), we obtain from [PW] that ’(s,) > 0 and hence u" (sx) > 0. This 
finishes the proof for Step 4 and hence completes the proof of Theorem 5.2. 


Following [N] we say a function pair (u, v) € C?([Ro, R,])* has mode m if u'(Ro) = 
u’(R1) = 0, v’'(Ro) = v'(R1) = 0 and (u’, v’) has the properties (i)—-(iii) in Theorem 5.2; 
we denote 


S= {(u, v)E C*([Ro, Ril)’: (u, v) has mode m}. 


Clearly each Sy, m= 1,2,..., is an open set in C2([Ro, R,]). We will use a global 
bifurcation argument to show that for any m > 1, (5.1) has a radial positive solution 
(u, v) € Sm, provided that A is large enough. 

Let us now regard a, B, y, 6 as fixed positive parameters satisfying (5.2) and regard 1 as 
a bifurcation parameter. Clearly (A, u*, v*) solves (5.1) for any 4. We will call this solution 
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the trivial solution, and look for nontrivial positive solutions. We will restrict to the class of 
radial solutions and use a bifurcation approach. The linearized eigenvalue problem of (5.1) 
at (u*, v*) in the class of radial functions is given by 


go" + (N — Ir 'o! —A(u*b + Bury) = —Ud, 
we" +(N — Dro!’ —A(u*$ + v*W) = —LY, (5.6) 
$' (Ri) = '(Ri) =0, i=0,1. 


Due to (5.2), it is easily seen that A has a positive eigenvalue «* and a negative eigen- 
value «~. Therefore there exists a matrix P such that 


Kk O ae L 
ptap=( ak where P= (?2 nF 
0 «kK Pr Pr 


(@)-"() 


then (5.6) becomes 


Define 


@"+(N —1)r7!@! +Ax-@ = — pO, 
W" + (N—1)r7!W’ + ctw = —py, (5.7) 
@'(R;)=W'(R;) =0, i=0,1. 


The eigenvalues of (5.7) are easily found to be yx; , (Tiss n=0,1,..., where 


ln = My — AK™, 
and 0 = Th < u < uy <.--- are the eigenvalues of the problem 

—$" —(N-1r7'$'=nd,  '(Ro) =4'(R1) =0. (5.8) 
Hence, zero is an eigenvalue of (5.7) exactly when 


waits, 9 50,1)2)0:., 


with the corresponding eigenfunction (®,,, 0) for A;,, and (0, ®,) for ene where @,, is the 
nth eigenfunction of (5.8). It is well known that ®/ has exactly n — 1 zeros in (Ro, R1). 
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Returning to (5.6), we find that zero is an eigenvalue of (5.6) exactly when A = A>,n = 
0, 1,2,..., and the corresponding eigenfunctions are given by 


(O75. Wan) = (PF Pn, Py Pn), 


where p; , Pz come from P and by a simple analysis one finds that Pr Pp <0, py Py <9. 
Therefore (¢7, Wy, ) € Sn+1- 

The above discussions enable us to apply both Theorems 1.1 and 1.2 to a suitable abstract 
version of (5.1) in the space of radial functions to conclude the following theorem. 


THEOREM 5.3. Let S denote the closure of the radial nonconstant positive solutions 
(A, u,v) of (5.1) in the space R! x C?([{Ro, Ri])*. Then for each n > 1, S contains a 
maximal subcontinuum S;, such that 
(i) Sy meets (At, u*, v*); 
(ii) S, either is unbounded or meets QA, u*, v*) for some he {Az: m=0,1,2,...}\ 
fA}: 
(iii) in a small neighborhood O7 


= of (A*,u*, v*) in R! x C?({Ro, R11)’, all the radial 
solutions of (5.1) lie on a smooth curve (A(s), u(s), v(S)), |S| < 50, where 


A(s) = AX + 0(s), (u(s), v(s)) = (u*, v*) + 5(¢7, vir) = 0(s). 


Let us analyze S, in more detail. By a well-known result of Conway, Hoff and Smoller 
[CHS], there exists A9 > 0 small enough such that for A € (0, Ao], (5.1) has only constant 
nonnegative solutions. We may assume that Ag € (0, AT): 

We claim that any (A,u,v) € Sy \ {(A;*, u*, v*)} satisfies A > Ao, (u,v) € Sn41 and 
u(r) > 0, v(r) > 0in [Ro, Ri]. In other words, 


(Su \ {Grew v")}) 
C An :={(A, u,v): A> Ao, (u,v) € Sn41,u > 0,v >}. (5.9) 


Otherwise, by the connectedness of S, and conclusions (i) and (1i1) in Theorem 5.3, there 
exists some (Ax, Ux, Ve) € (Sp \ {Aay, u*,vu*)}) NdOA,. Hence (ux, v,) is a nonnegative 
solution of (5.1) with A = 1,. If it is not a positive solution, then by the strong maximum 
principle, (u,v) has at least one component identically zero. This implies that (u,v) € 
{(0, 0), (a, 0), (0, y)}. As bifurcation to positive solutions from these solutions is possible 
only at A = 0 (due to (5.2)), we find this is a contradiction. Therefore (u,, vs.) has to be a 
positive solution. 

If (Ux, Vx) = (u*, v*), then we can find (Ax, ug, vg) € Ap that converges to (Ax, u*, v*) 
in R! x C*({Ro, R1])*. By conclusion (iii) in Theorem 5.3, this is possible only if 
Ax = AZ. Since Ax > Ao > O and A, <0, Ax =A, is impossible. Since (Ax, Ux, Vx) € 
(Sn \ (Oss u*,v*)}), Ax = At is also impossible. Therefore (u,., vx.) must be a nonconstant 
positive solution of (5.1), and by the definition of 49, we know that 2, > 49. Moreover, by 
Theorem 5.2, (ux, Vx) € Sm+1 for some m > 0. Since (ux, vs) can be approached in the 
C? norm by functions in S,41, we necessarily have m =n. But then (A,, ux, vy) belongs 
to the interior of A,. This contradiction proves that (5.9) is true. 
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By (5.9) and conclusion (iii) in Theorem 5.3, we know that the second alternative in (ii) 
of Theorem 5.3 never occurs. Hence S, is unbounded. A simple comparison argument 
shows that every nonnegative solution of (5.1) satisfies u < @ and v < y. Therefore by 
standard elliptic estimate we know that u and v have bounded C? norms as long as 2 > 0 
stays bounded. This implies that S, can become unbounded only through 4 > ov. To 
summarize, we have the following theorem. 


THEOREM 5.4. For each n > 1, (A, u,v) € Sp \ {(A, u*, u*)} implies that (u,v) is a 
nonconstant positive radial solution of (5.1); moreover, (u,v) belongs to Sy+1, and the 
projection of Sj on R! contains (Ar, oo), and is contained in (Ag, ©) with some ho > 0. 
Hence for each i > d*,, (5.1) has at least m nonconstant positive radial solutions. 
REMARK 5.5. 1. The conclusion of Theorem 5.4 can be strengthened. In fact, each S, 
can be decomposed into two unbounded subbranches S;* and S; satisfying Sh NS) = 
{Aaz, u*, v*)}. Hence (5.1) has at least 2m nonconstant positive solutions for A > Ae 

2. By considering the linearization of (5.1) at (u*, v*) in the space C*(2), one easily 
sees that the linearized eigenvalue problem has eigenvalues corresponding to nonradially 
symmetric eigenfunctions. This fact can be used to construct examples where (5.1) has 
many nonradial positive solutions bifurcating from (u*, v*). 

3. For large 6 and 6, one can also use the method in [DD1] to construct nonradially 
symmetric positive solutions for (5.1). 

4. It is unclear whether (°° , S; contains “all” the radial nonconstant positive solutions 
of (5.1) (with A > 0). 

5. In Kan-on [Ka], it is shown that if wa = y and 6 = 6 in (5.1), and if the space dimen- 
sion is one, then each S,, is exactly ““C’’-shaped, and tee 1 On contains “all” the noncon- 
stant positive solutions of (5.1) (with A > 0). 

6. If 2 is a ball (in general, if it is a convex set), then any nonconstant positive solution 
of (5.1) is unstable; see [KW]. 


5.2. Uniqueness results for the predator-prey system 


We consider the Lotka—Volterra predator-prey system with constant coefficients and ho- 
mogeneous Dirichlet boundary conditions 


—Au=aAu —u* — cuv, 
—Av=pvu—v?+duv, (5.10) 


ulaa =v\lag =9, 


where $2 is a bounded smooth domain in R%. It has long been conjectured that (5.10) 
has at most one positive solution, but the conjecture remains open except when the space 
dimension is one, namely when 2 is an interval. 

In contrast, the existence problem for (5.10) is completely understood. In the following 
discussion, we will use some notations of Section 3. If A > ae , then (0,, 0) solves (5.10). 
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Similarly, (0, 6,,) solves (5.10) when pz > a . Suppose that (uo, vo) 1s a positive solution 
to (5.10). Then from the equation for up we obtain 


A=A? (up + cup) > a”. 
Similarly, from the equation for vo it follows 
=A? (vp — duo). 


A simple comparison argument shows that uo < @ and vp > 6,,; here we use the conven- 
tion that 6, =O if w< re? . Therefore 


[> AP (vo — dO) > AP (—dO,) == Mo. 

Similarly, 
ASAP (Uo + COn) > AP (cOn). 

Suppose A > xe and let 9 > ae be uniquely determined by 
A =A? (cO,,0). 


We find from the above discussions that a necessary condition for (5.10) to possess a posi- 
tive solution is that 


hake, wo <w<p. (5.11) 


We show next that (5.11) is also sufficient for (5.10) to have a positive solution. To 
this end, we fix the positive coefficients A,c,d and regard yz as a bifurcation parame- 
ter. Under (5.11), we can apply the local and global bifurcation analysis much as for the 
competition model in Section 3.1, to conclude that there is a global bifurcation branch 
» = {(, u, v)} of positive solutions to (5.10), which bifurcates from the semitrivial branch 
{(w, 6, 0)} at (440, @, 0), and joins the other semitrivial branch {(j1, 0, ,,)} at (n°, 0, 01,0). 
Therefore, for any jz € (0, pe), (5.10) has at least one positive solution (u, v) such that 
(U,u,v) ED. 

In the following, we will make use of the nodal properties of certain differential systems 
to show that if 2 is an annulus, 


R@={x ERX: Ry <|x|< Ro}, O< Ri < Ro, (5.12) 


then the global bifurcation branch » consists of radially symmetric positive solutions only, 
and it is a smooth curve, and for each pu € (U0, pe); there is exactly one positive solution 
(u, v) of (5.10) such that (uw,u,v) € XY. 

Suppose that (5.12) holds. Let us first observe that, by uniqueness, @, and 6@,, are ra- 
dially symmetric, and if we apply the local and global bifurcation analysis in the space 
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of radially symmetric functions, we obtain a global branch of radially symmetric posi- 
tive solutions of (5.10), which we denote by &,, and X'. connects the semitrivial solution 
branches at (j19, 0), 0) and (w°, 0, 91,0) respectively. We will show that 2’ = 2’.. We do 
this by considering the linearization of (5.10) at an arbitrary radially symmetric positive 
solution (u(x), vo(x)) = (uo(r), vo(r)) 


—Ag = (A — 2uo — cv0)b — cuoy, 
—Aw = (u— 29 + duo) W + dvod, (5.13) 
glae =Vlaa =9. 


THEOREM 5.6. Suppose that (5.12) holds and (@,) € C?(Q)* solves (5.13). Then 
(¢,¥) = (0,0). 


PROOF. We assume that N > 2; the case N = | can be proved by similar arguments and is 


simpler. Arguing indirectly, we assume that (5.13) has a solution (¢, Ww) 4 (0, 0). We are 
looking for a contradiction. 


STEP 1. Reduction to ODE systems by harmonic polynomials. 


We first use harmonic polynomials to reduce (5.13) to a sequence of ODE systems. (This 
is not needed if N = 1.) 

Let #(” denote the space of homogeneous and harmonic polynomials of degree n in 
N variables. It is well known that the restriction of these polynomials to the unit sphere 
S‘-! are the eigenfunctions of the Laplace—Beltrami operator A sN-1 Corresponding to 
the eigenvalue A, = —n(n+ N —2),n=0,1,2,.... Moreover, the following orthogonal 
decomposition holds 


17(S*-!) = Dx" (5.14) 


n>0 


Given P,, € H” define 
fin= | ore yr) dow, w= f Ww (r&) Pi(&) do (&). 


Then (f,g) € C?([Ri, R2])”, and f(Ri) = f (Ro) = 0, g(Ri) = g(R2) = 0. Moreover, 
since the Laplace operator in R™ can be expressed as 


A=A,+r7Agn-1, 
where 


r= |x|, Ape ae on); 
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if we multiply the differential equations in (5.13) by P, () and integrate on S‘—!, it results 


—A,ftnin+N —2)r*f 
= (A—2u9—cvo) f —cuog, re(Ri, R2), 


—A-g+n(n+ N —2)r~*g (5.15) 
=(u—2v9 + duo)g+drof, re€(R1, Ro), 
f (Ri) = g(Ri) = 0, i=1,2. 


STEP 2. There exists some Py, € H", n > 0, such that problem (5.15) has a solution 


(f, 8) FO, 0). 


Otherwise, for all P, € 7H”, n > 0, (5.15) has only the solution (0,0). Hence for each 
r €(R1, R2), &(ré) is orthogonal in L?(S%—!) to every H", n > 0. It follows from (5.14) 
that d(ré) = 0. Hence 6 = 0 in £92. Similarly y = 0. But this contradicts our assumption. 


STEP 3. The zeros of f and g in[Rj, Ro] are isolated. 


We only prove the conclusion for f; that for g is similar. Suppose for contradiction that 
ro € [R1, Ro] is an accumulating point of zeros of f in [R1, R2]. Then we easily see that 
f (ro) = f' (ro) = O. If g(ro) = g'(ro) = 0, then we deduce (f, g) = (0, 0) by uniqueness 
of the initial value problem for (5.15). Hence either g(ro) 4 0 or g’(ro) #0. Therefore we 
can find an open interval J C [R1, R2] with ro as an end point and a sequence of zeros {rx} 
of f such that {rg} C I, rg — ro and g(r) £0 for all r € 7. From the equation for up we 
find Af? (—A + uo + cv) = 0. It follows that 


Ay? (—A +2uo +cv9 +n(n + N —2)r~?) > 0. 


If we denote 2) = {x € 92: |x| € I}, where [; denotes the interval with end points 
ro and rj, we obtain 


a (—A +2u9 +cvp tn(n+N — 2)r~*) 
> re (—A + 2ug9+cvptn(n+N— 2)r7*) >0. 


This implies that the strong maximum principle is satisfied by the operator 
Ly:= (-A —A+2ug+cv9p tn(n+N — 2)r~*) 


over 22): Lyu > O0in 2; and u > 0 on 0X2); imply u > 0 oru =O0in 22. 

If we identify f(r) with f(|x|), then from (5.15) we obtain Lif = —cuog and 
flag, = 0. Therefore by the strong maximum principle we have either f =O in 2, or 
f does not vanish and has the opposite sign to g in §2). If f is identically 0 then by (5.15) 
we must have g identically zero over §2; and hence by uniqueness of the initial value prob- 
lem for (5.15) we deduce (f, g) = (0,0) over 82; a contradiction. If f does not vanish 


204 Y. Du 


in §2;, then we arrive a contradiction with the fact that 7; contains infinitely many zeros 
of f(r). Therefore the zeros of f in [R;, Ro] must be isolated. 


STEP 4. Let Rj < & <--+ <& = Rp be the finite sequence of zeros of f where f changes 
sign, and assume that f > 0 in (R1, &1). Then 


(-1)/ g(&;) > 0, JH Ay. oxip; (5.16) 


Before starting the proof for Step 4, let us note that we do not lose generality by as- 
suming f > 0 in (Ri, &1); we may change (f, g) to (— f, —g) otherwise. Note also that 
(—1)?g(&p) > 0 is a contradiction to the fact that ¢(R2) = 0. Therefore this step finishes 
the proof of the theorem. 

We now prove Step 4 by an induction argument. For j = 1, suppose for contradiction 
that ¢(&,) > 0. Denote 929 = {x € 2: R, < |x| < &}. From the equation for vg we find 
that A? (-w + vo + duo) = 0. Hence 


aP0(—p + 2v0 + duo +n(n + N — 2)r7?) 


> AP (—w + 2u9 + duo +n(n +N —2)r~’) > 0. 
It follows that the strong maximum principle holds over {29 for the operator 
Lo:= (—A —pw+2v9+duptnn+N— ar). 


It now follows from L2g = duo f > 0 in Qo and glagq, 2 0 that g > 0 in £20; note that by 
Step 3, g cannot be identically 0 in (2. 

Similarly we find that the strong maximum principle holds over (29 for the operator L1 
used in the proof of Step 3. It then follows from Lj f = —cugg < 0 in {29 and flaq, =9 
that f <0 in £29. This contradiction proves (5.16) for j = 1. 

Suppose (5.16) holds for some i > 1. If i is odd, then g(&;) <0 and f < 0 in (§;, &41). 
Suppose for contradiction that g(xj41) < 0. Denote 2; = {x € Q: & < |x| < &+41}. By 
the same reasoning as before, the strong maximum principle is satisfied by L; and L2 
over 02;. We have Log = duo f <0 in 9;, and glag, <0. Hence g <0 in 92;. It follows 
that L) f = —cuog > 0 in 922;, flag, =9; hence f > 0 in 92;. This contradiction shows 
that we must have g(&;+1) > 0. If i is even, the proof is similar. Therefore (5.16) holds for 
all 1 < j < p. The proof is complete. 


We are now ready to prove the following result. 


THEOREM 5.7. Suppose that (5.12) holds. Then X/ = LX’. Moreover, &' is a smooth curve 
which can be parameterized by wu € (j49, “°), and ¥ contains all the radially symmetric 
positive solutions of (5.10). Therefore for each ju € (U0, L°), (5.10) has a unique radially 
symmetric positive solution. 


PROOF. By the local bifurcation analysis near (19, @,, 0) and (n°, 0, 61,0) » and &}. co- 
incide and consist of smooth curves near these points. Away from these two points, by 
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Theorem 5.6, we can apply the implicit function theorem to conclude that 2’, is a smooth 
curve which can be parameterized by jw. 

Suppose for contradiction that +’ # 2. Since they agree near (jig, 0,,0) and 
(a5 0, 81,0) we can find some (41, u,v) € &'. which can be approached by a sequence 
(Lk, Uk, VE) € S' \ X'-. But this is impossible since near (4, u, v), due to Theorem 5.6, we 
can apply the implicit function theorem to conclude that all the solutions to (5.10) form a 
smooth curve parameterized by jz, which necessarily agrees with X'.. This proves 4’ = 2’... 

Suppose now ({2, #, 0) is an arbitrary radially symmetric positive solution of (5.10). By 
Theorem 5.6 we can apply the implicity function theorem in the space of radially symmet- 
ric functions to conclude that, near (1, “, 0), all the radially symmetric positive solutions 
of (5.10) form a smooth curve parameterized by yx. Let X’ denotes a maximal such curve 
and define wx = {u: (u,u,v) € X’}. By (5.11), we necessarily have x € [Wo, pny If 
[Lx > do, then we can easily deduce that there exists some (jx, Ux, Ux) € &”, and we can 
apply the implicit function theorem to continue the curve X’ to uw < fx, contradicting the 
definition of ww. Hence we must have jz, = (49. We now can use the equations in (5.10) 
to easily show that (419, 0,,0) is an accumulating point of 2’. By the local bifurcation 
analysis near (j19, 6,, 0), we see that X” agrees with X, near this point. Now ©’ = XY, can 
be proved in the same way as we prove » = 27. 


REMARK 5.8. 1. In Theorems 5.6 and 5.7, the restriction that the coefficients in (5.10) 
are constants is not necessary; they can be radially symmetric functions. Moreover, these 
results remain true if (2 is a ball. See [DLO] for details. 

2. In the one-dimensional case, the method of using nodal properties of the solutions 
to (5.13) to prove Theorem 5.6 and hence the uniqueness of positive solutions to (5.10) 
seems first used by L6pez-G6mez and Pardo [LP1]. This method can be extended to similar 
problems with general homogeneous boundary conditions, see [LP2]. In [Hs], a related 
method was used to discuss a problem with homogeneous Neumann and inhomogeneous 
Dirichlet boundary conditions. 

3. Whether the unique radially symmetric positive solution of (5.10) is linearly stable is 
an open problem. Theorem 5.6 rules out the possibility of symmetry breaking bifurcation, 
but it does not rule out the possibility of Hopf bifurcation along 2. In [Y], by a local 
bifurcation analysis, it was shown that the positive solutions are linearly stable near the 
semitrivial solutions. 

4. If we replace the Dirichlet boundary conditions in (5.10) by Neumann boundary con- 
ditions, then it is known that the positive constant solution is a global attractor of the corre- 
sponding parabolic system with any positive initial data; this can be proved by a Lyapunov 
function argument and relies on the assumption that the coefficients are constants, but it 
works for an arbitrary §2; see [AMR]. 
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Abstract 


This paper analyzes how the study of the interplay within the same habitat between the most 
classical laws of Population Dynamics is originating the modern theory of nonlinear parabolic 
differential equations, where metasolutions are imperative for ascertaining the dynamics in the 
regimes where they cannot be described with classical solutions. 
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1. Introduction 


Our attention in this monograph is focused into the problem of ascertaining the asymptotic 
behavior of the solutions of 


4 _ Au=)u—a(x)f(x,u)u in 2 x (0,00), 
u=0 on 082 x (0, 00), (1.1) 
u(-,0) =ug > O in £2, 
where {2 is a bounded domain of R%, N > 1, with smooth boundary 082, e.g., of class C3, 
A €R, anda >0, a £0, is a function of class C“ (2), for some yz € (0, 1], satisfying the 


following hypotheses: 
(Aa) The set 


Q_:= {x € 2: —a(x) <0} 


is a subdomain of 2 with 2_ C 2, whose boundary, 0S2_, is of class C3, and the 
open set 


29 := B\ 2 
consists of two components, 29,;, 1 € {1,2}, such that 
20,190202=9, 222, 
and 
0 :=o[—A, 920,1] < 02 :=oa[—-A, 202]. (1.2) 
Throughout this paper, given a regular subdomain D of 2 and V € C(D), we denote by 
o[—A + V, D] the principal eigenvalue of —A + V in D under homogeneous Dirich- 


let boundary conditions. Figure 1 represents a typical situation where assumption (Aa) is 
fulfilled. In Figure | we have denoted 


I =022, Ty =0201\T, Ty) := 0202, 02_-=1,UI». 


Thanks to Faber—Krahn inequality, (1.2) is reached if $29.2 has a sufficiently small 
Lebesgue measure (e.g., [43], Section 5 and [10], Section 10). Actually, one might think 
of (1.2) as a sort of hierarchical ordering size between the components (29,1 and §20,2 es- 
tablishing that (29,1 is larger than §29,2, though one should take into account that o[— A; D] 
can depend on certain hidden geometrical properties of D. Setting 


09 :=o0[—-A, 2], 
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Fig. 1. Nodal configuration induced by a(x). 


it is apparent, from (1.2) and the monotonicity of the principal eigenvalue with respect to 
the domain, that 


090 < OO] < O02. (1.3) 


As for the function f(x, u), we suppose the following: 
(Af) f €C%!+#(2 x [0, 00)) satisfies 


f(,0)=0 and a, f(x,u)>0 for all x € 2 andu > 0. 
(Ag) There exists g € C!+({0, 00)) such that 


g(0) =0, g(u)>0O and g’(u)>O0 forallu>O, ree = 00, 


where “’” denotes i, and 
f(,w 2g) ifuso. 
Note that (Af), (Ag) imply 


lim f(x,u)=00 uniformly in x € 2. 
utoo 


Subsequently, we assume (Af), (Ag), and for every constant A > 0 and compact set 
KC 82_ we consider the auxiliary function 


hx, AU) :=az xg(uju— Au, ueé[0,oo), (1.4) 
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where 


aL.K =onne > 0. 


Under assumption (Ag), it is apparent that hx, has a unique positive zero. Let denote 
it by ux,a. The following assumption is crucial to get uniform a priori estimates for the 
solution of (1.1) within 2_: 

(Ah) For every pair (K, A) andu >ux,, 


eo) s —1/2 
Iu) =a | / hg.a(2) | ds < co (1.5) 
and 
Hs I(u) :=0. (1.6) 


Assumption (Ah) holds if 
g(u)=nu?', u>0, 
for some 7 > 0 and p > 1. Indeed, in such case, 
hx atu) :=az xg(uju— Au=az xnu?— Au, uso, 


and hence, 


( A ee 
UK,A= ; 
aL,KN 


Thus, for each s > u > uxK,a, 


Ss S 
i; hx,a(z) dz =f (ar,«nz? — Az) dz 
u u 


= ee uP!) 


7 pt+il (s° uw’) 


and therefore, by performing the change of variable s = u@, we find that 


oo S19 
1a) = f | ee (srt uP!) (3? ”)| ds 


_ —1/2 

-{ [= “(et 1) 4 6? | do 
1 pt+l 2 

<O, (1.7) 
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since the function R(@) defined by 


a uP! K 
RO) := or (9?+! 1) : (02-1), 050, 
satisfies 
pe a Rl) =az,cqu?!— A >az.xnuk —A=0 
and 


_ RO) ar,«nu?! 
lim =— >0 
6400 ptt pti 


Moreover, it is easy to see that (1.7) implies (1.6). Therefore, (Ah) holds true for this choice 
of g. 

In Ecology, (1.1) models the evolution of the distribution of a single species u(x, t) ran- 
domly dispersed in the inhabiting area §2, where 4 represents the intrinsic growth rate of 
u and a(x) measures the crowding effects of the population in (2_. In 20, u is allowed to 
enjoy exponential growth according to the Malthus law. In our setting, the inhabiting area 
{2 is fully surrounded by completely hostile regions, because of the homogeneous Dirich- 
let boundary conditions on 02. The function uo € C (2), ug > O, represents the initial 
population distribution. Consequently, (1.1) can be viewed as a sort of intermediate proto- 
type model linking the Malthus and the Verhulst laws of population dynamics within the 
same inhabiting region. Indeed, if f(x, uw) =u, Q_ = 2 and a(x) > 0 for each x € 022, 
then (1.1) provides us with the classical spatial logistic equation, while it provides us with 
the classical spatial Malthus equation if $2. = 4. Our main goal in this work is ascer- 
taining the interplay between these two angular laws of population dynamics when they 
arise simultaneously in a heterogeneous environment of the type illustrated in Figure 1. 
Although in the classical cases when (2_ € {¥, 82} the dynamics of (1.1) is governed by 
the nonnegative steady-states of (1.1), i.e., by the nonnegative solutions of 

Cae ee in Q, (1.8) 
u=0 on 082, 


in our general setting a new class of nonclassical nondistributional generalized steady- 
states must be incorporated to the mathematical analysis of the problem in order to describe 
the asymptotic profiles of the population as time passes by. Namely, the metasolutions. 
Roughly spoken, the metasolutions of (1.1) are the extensions by infinity of the explosive 
solutions, or large solutions, of 


—Au=hu —af(-,u)u (1.9) 


in D € {Q \ 20,1, Q_}. From the biological point of view, the main results of this paper 
can be shortly summarized as follows: 
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The inhabiting region §2 cannot support the species u if A < 00. 
The species u grows according to the Verhulst law if 09 <A <0}. 
e The species u grows according to the Malthus law in 20,1, while it is governed by the 
Verhulst law in 2 \ Qo, ifo, <A <0. 
e The species u grows according to the Verhulst law in 82_, while it exhibits Malthusian 
growth in 2 \ Q_ ifr’ >o». 
Consequently, the nature of the evolution of a single randomly distributed spatial species 
in a heterogeneous environment might suffer drastic changes according to the size of its 
intrinsic growth rate, evolving from extinction and logistic growth up to exhibit a genuine 
exponential growth within the most favorable regions, as in such cases most of the individ- 
uals of the population tend to abandon the most hostile areas for colonizing the favorable 
regions where natural resources are almost unlimited. A most detailed discussion, once 
stated the main mathematical results of this monograph, will be carried out in Section 2. 

Besides the huge intrinsic interest of analyzing (1.1), as a result of the wide variety of its 
applications in the applied sciences and engineering, analyzing (1.1) is imperative as well 
from the point of view that it is a cell model for designing more sophisticated — so, more 
realistic — multispecies interacting models. Actually, it has been recently shown that the as- 
ymptotic profiles of the solutions of (1.1) also provide us with the dynamics of the positive 
solutions of large classes of superlinear indefinite problems, where a(x) changes of sign 
(cf. Section 8). Therefore, the theory of metasolutions developed in this monograph should 
be a milestone to generate a great variety of new mathematical results in analyzing the 
effects of spatial heterogeneities in Chemistry, Biology, Ecology, Economy and Physics, 
so tremendously facilitating the understanding of the role of spatial heterogeneities in the 
formation and diversity of the Universe. 

Throughout this paper, given a subdomain D C Q and a function u € C(D), it is said 
that u > 0 if uw >0 and u 40. Accordingly, given u,v € C(D), it is said that u > v if 
u—v> 0. Also, given u € C!(D), it is said that w >> 0 if u(x) > 0 for each x € D and 
ee (x) <0 for each x € 9D Nu—!(0), where nx stands for the outward unit normal of D 


at x € OD. Accordingly, given u, v € C!(D), it is said that u>> v if u—v>0. 
Under our regularity assumptions, (1.1) possesses a unique smooth classical solution 


U(x, t) = Up,,.2\(%, 5 Uo) 
globally defined in time since 
—af(-,uju <0. 


Moreover, by the parabolic maximum principle, u(-, t) >> 0 for each t > 0, since uo > 0. 
The main goal of this work is ascertaining the behavior of the population distribution as 
time passes by, i.e., characterizing the limit 


L:=limu(,f), (1.10) 
ttoo 


if it exists, according to the several ranges of values where the intrinsic growth rate 4 varies. 
In terms of L, the main results of this paper can be listed as follows: 
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e L=0ifrA<oo. 

© 0<L<owifo9<A<o,. 

e L=oo in 29 \ 92 and0<L <cwinQ\ 21 ifo, <A <a. 

e L=winQ\ Q2_ and0<L <ooin Q_ ifrA S02. 
This monograph is distributed as follows. In Section 2 we state the main results and dis- 
cuss their biological meaning. In Section 3 we collect the characterization of the strong 
maximum principle found by L6pez-Gémez and Molina-Meyer in [53] and characterize 
the dynamics of a class of general parabolic problems related to (1.1). These results are 
crucial in the subsequent mathematical analysis. In Section 4 we give some preliminary 
results that will be necessary to prove the results of Section 2, among them count some 
classical problems of logistic type and some substantial improvements of the classical uni- 
form a priori bounds of Keller [38] and Osserman [61]. In Sections 5—7 we will prove 
the results of Section 2. Finally, in Section 8 we describe the genesis and evolution of the 
mathematical theory of metasolutions and discuss some further, very recent, applications 
to porous media and indefinite superlinear problems. 

Throughout this paper, given two real Banach spaces X and Y and a linear continuous 
operator between X and Y, say L, N[L] and R[L] will stand for the null space — kernel — 
and the range — image — of L. 


2. The main results 


Throughout this section we will assume that a(x) satisfies (Aa) and that f satisfies (Af), 
(Ag) and (Ah), though some of the results might be valid under much weaker assumptions. 
Then, any weak solution of (1.9) in a smooth subdomain D C §2 must live in C2+H(D). 
The solution of (1.1) satisfies 


ue C2telts (2 x (0, oo). 


Throughout this paper, given a smooth subdomain D C 2 and M é€ [0, oo], we consider 
the family of elliptic boundary value problems 


21 
u=M on oD. Cy 


—Au=dAu —a(x)f(x,u)u in D, 
Any weak solution u of (2.1) must satisfy u € Core (D) if 0 < M < ~, while, in case 
M =x, a function u € C?+“(D) is said to be a solution of (2.1) if it satisfies the differen- 
tial equation in D and 


lim u(x) =o0. (2.2) 
xeD 
dist(x,dD))0 


Throughout this paper, such solutions are called large solutions — or explosive solutions — 
of (1.9) in D (cf. [6,57] and the references therein). 

The following result characterizes the existence of large solutions of (1.9) in 92_. These 
solutions will provide us with the limiting profiles of the solutions of (1.1) when A > 0. 
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THEOREM 2.1. Suppose M = 00 and D = &2_. Then, for each i € ae (2.1) possesses a 
minimal and a maximal positive solution, denoted by Li "O_ ) and LR lh On p Tespectively — 
in the sense that any other positive solution L of (2.1) must satisfy 


an (cK rae ° (2.3) 


The following result characterizes the existence of large solutions of (1.9) in 2 \ 20,1. 
These solutions will provide us with the dynamics of (1.1) for the range 01 <A <0. 


THEOREM 2.2. Suppose M = oo and 
D= \ 201 = 2_U 20.2. 


Then (2.1) possesses a positive solution if and only if ) < 02. Moreover, for each i < 02, 


ne) iy i min max 
(2.1) has a minimal and a maximal solution, denoted by L (2, 2\5o.1 and L [.,2\2o7 


spectively — in the sense that any other solution L of (2.1) must ae 


min max 
Lia\@o11 S © Sp aaa 24) 


Moreover, there exists a large solution of equation 
—Au =o02u —af(-,u)u 
in Q_, say Lig,,Q_}, Such that 


(exe) in 20 2, 
lim L™ : 2.5 
Moz, Ds, Q\2oi1— Lio3,Q-] inQ_. aa 


The following result characterizes the existence of positive solutions of (1.8), which 
equals (2.1) if M=0 and D= 92. These solutions will provide us with the dynamics 
of (1.1) within the range 09 <A <0}. 

THEOREM 2.3. Problem (1.8) has a positive solution if and only if 


00 <A<oj. 


Moreover, it is unique, if it exists, and if we denote it by 0[),Q), then 


lim O,,2}=0 inC(2), (2.6) 
ALo0 

and 
see a in 20,1 \ AQ, OFT 
oe [A,2]= ) pmin _ in 2 \ Qo,1. = 


[o1,2\20,1] 
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Furthermore, the map 


(00, 01) > C(@), oe 
AP O(a) = On.0] 


is point-wise increasing and of class C!. 
The following result provides us with the dynamics of (1.1). 


THEOREM 2.4. Let u(x,t) := uj,,a\(x, t; uo) denote the unique solution of (1.1). Then 
(a) limytoo u(-, t) = 0 in C(2) if a < 90. 
(b) limstoo u(-, 1) = Aa,Q] In C(Q) ifo9 <A < 04. 
(c) In case 01 <X < 02, the following assertions are true: 
(i) lim; too u(-, t) = 00 uniformly in compact subsets of 201 \ 082. 
Gi) In 92 \ 20,1 the following estimate is satisfied 


min 
9 Bes 
[A,.Q\ 2,1] ~ 


max 


pee t) <limsupu(-,t) < Liy.2\2oal° 


ttoo 
(iii) If, in addition, ug is a subsolution of (1.9) in 2, then 


: —ymn _ . >. 
ors t)= Li @\Bol in 2 \ 21. 
(d) In case X > 02, the following assertions are true: 
(i) lim; too u(-, 1) = 00 uniformly in compact subsets of 2 \ Q_. 
(i) In 92_ the following estimate is satisfied 


Lg) <liminfu(.,t) <limsupu(-,t) < LB" 3. 
ttoo ttoo 


(iii) If, in addition, ug is a subsolution of (1.9) in 2, then 


lim u(t) = Lm in Q_. 
too on [A,2-] 


The statements of Theorem 2.4(c) and (d) can be substantially shortened by introducing 
the following concept. 


DEFINITION 2.5. Suppose M = ow and De {2 \ 20.1, 92_}. Then, a function IN: 2Q > 
[0, oo] is said to be a metasolution of (1.9) supported in D if there exists a large solution 
L of (1.9) in D for which 


in 2\ D 
m= {% in Q\ D, 
LCL inD. 
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The metasolution 90 is said to be the minimal (resp. maximal) metasolution of (1.9) in 
D if L is the minimal (resp. maximal) large solution in D. The minimal and the maximal 


metasolution of (1.9) in D are throughout denoted by mn ; py and Mrs = 2. Dp respectively. 


Using Definition 2.5, Theorem 2.4(c) shows that, if 0) <A <2, 


min max je 
Ty ovo SEs Pra O< MN 2\ 501] in 22, 
and actually, 
P min s 
Pe yo Vaon in 22 


if, in addition, uo is a subsolution of (1.9) in 22. 
Similarly, thanks to Theorem 2.4(d), for any A > 02 we have that 


iS liminfu(, t) <limsupu(.,t) < 2] in Q. 
too ttoo 


Moreover, 
limu(.,2 =e, , in@ 
nes ) [2.@_] im 
if, in addition, wo is a subsolution of (1.9) in £2. 

As a result from these features, the dynamics of (1.1) is governed by the maximal clas- 
sical nonnegative solution of (1.9) if A < 01, by the metasolutions of (1.9) supported in 
92 \ 829, if 01 <A < 02, and by the metasolutions of (1.9) supported in §2_ if A > 02. 

The following results provide us with some sufficient conditions for the uniqueness of 
the metasolution of (1.9) supported in D € {92 \ 29,1, Q_}. 

THEOREM 2.6. Suppose 
fjw=uP!, (x, u) € 2 x [0, 00), (2.9) 


for some p > 1, and there exist 


BEC(I};(,00)) and y €C(I; (0, 00)) 


such that 
a(x) BE , 
lim =1 = uniformly inx,; €T). (2.10) 
mee EPC UIGSNE, Tye 
xEQ 
Then, for each X < 02, 
pm — apmax _ ae 


[A,2\ 291] [A, 2\ Ro.) 


222 J. Lopez-Gomez 

i.e., (1.9) possesses a unique large solution in 82 \ 20,1. Therefore, (1.9) possesses a unique 
metasolution supported in 92 \ §20,1, subsequently denoted by Mey 2\ Fo yp and, due to 
Theorem 2.4(c), Ma 2\2o ,| 8 @ global attractor for the solutions of (1.1) ifo1 <A < 02. 


THEOREM 2.7. Suppose (2.9) and there exist 


BEC(IR_;(0,00)) and y €C(dR_; (0, 00)) 


such that 
a(x) ; 
lim - =1 = uniformly in x; € 0Q_. (2.12) 
x>x1 B(x1)[dist(x, M)]”°0 
xEQ_ 
Then, for each X€ R, 
Deo y= ia oo (2.13) 


i.e., (1.9) possesses a unique large solution in Q_. Consequently, (1.9) possesses a unique 
metasolution supported in $2_, subsequently denoted by IWN,Q |, and, due to Theo- 
rem 2.4(d), INia,@_] is a global attractor for the solutions of (1.1) if X > o2. 


The next result shows the continuity and monotonicity in 4 of the metasolutions of (1.9) 
supported in D € {2 \ 201; §2_} under the assumptions of Theorem 2.7, though the result 
remains valid assuming the uniqueness of the metasolution for every value of the parameter 
where it exists. 


THEOREM 2.8. Under the assumptions of Theorem 2.7, each of the maps 


MO 2 1 
(2.14) 
Ae Mer 2, (A) = Mey ,.2\ 21] 
and 
Me_ 
R — C(2; (0, 00)), 
(2.15) 
Ar Me CA) := Maa] 
is continuous and point-wise increasing. Moreover, 
ne O(A) = Moy, (01) and er Moa, (A) = Mte_(o2), (2.16) 


where @ is the solution map defined in (2.8). 
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u(x) 


Fig. 2. The dynamics of (1.1). Classical solutions and metasolutions. 


In Figure 2 we have represented the dynamics of (1.1) under the assumptions of Theo- 
rem 2.7. Most precisely, we have drown the diagram of classical solutions and significant 
metasolutions of (1.9) together with their respective attracting properties. We are plotting 
the parameter A versus the value of the generalized solution, u(x), at some point x € 2_, 
where all these generalized solutions are finite, so that the diagram cannot exhibit any bi- 
furcation from infinity. The diagram shows four different kind of solutions. The A-axis rep- 
resents u = 0, which, according to Theorem 2.4(a), is a global attractor if 4 < 09, while it 
is linearly unstable for any 2 > oo. Then, we have represented the positive solution 6) 2], 
which bifurcates from u = 0 at 4 = oo and it is point-wise increasing for A € (00, 01) un- 
til it reaches the metasolution Mio, 2\ 7,1] at A = 01. Due to Theorem 2.4(b), 61,,.Q] is a 
global attractor of (1.1) for each 4 € (09, 01). Then, we have represented the curve 


A> Mey 2\ G10): 


which, according to Theorem 2.8, is continuous and increasing in its definition interval 
(—oo, 02). Thanks to Theorem 2.4(c), Me, 2\8o.11 is a global attractor for the solutions 
of (1.1) if A € [o1, 02), and, due to Theorem 2.2, it approximates the metasolution IN, ,2_] 
as i + o2. As for any 4 < o; the dynamics of (1.1) is described by the classical nonnegative 
steady states of (1.1), in such range the metasolution 20, Q\ Ho, Must be unstable from 
below. Consequently, the value 4 = o1 provides us with the critical value of the parameter 
where the attractive character of the metasolution supported in 2 \ 2o,; changes. Finally, 
Figure 2 shows the curve 


A> Mpe_1™), 


which, according to Theorem 2.8, is continuous and increasing in R. Thanks to Theo- 
rem 2.4, Iti,,@_] is a global attractor for the solutions of (1.1) if A > o2, while it is unstable 
from below if A < 02. So, A = 02 is the critical value of the parameter where the attractive 
character of SIti,,_}] changes. Figure 3 shows the corresponding asymptotic profiles of the 
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Fig. 3. The limiting profiles of the solutions of (1.1). 


solutions of (1.1) according to the range of variation of the parameter A. Although for a 
general nonlinearity f(x, u) satisfying (Af ), (Ag) and (Ah) our theory does not guarantees 
the uniqueness of the metasolution, due to Theorem 2.4, Figure 2 still provides us with the 
dynamics of (1.1) when uo is a subsolution of (1.9), though in this case one should think 
of the minimal metasolution curves, which might exhibit a number of jumps as a result of 
the eventual nonuniqueness of the metasolutions. Nevertheless, though we could not prove 
it yet, we conjecture that the metasolutions supported in £2 \ 20.1 and §2_ must be unique 
for a general a(x) satisfying (Aa) and f(x, uw), not necessarily of the special form (2.9). 
Theorem 2.4 is of fundamental interest from the point of view of the applications of the 
abstract mathematical theory developed here to population dynamics as it provides us with 
the simultaneous effects of incorporating both Malthus and Verhulst laws within the same 
natural environment, which should be extremely realistic from the point of view of appli- 
cations to real world models. Rather naturally, the density of the species should be severely 
limited in the regions where natural resources are drastically limited, though it might be 
certainly unlimited within the regions where natural resources are sufficiently abundant to 
maintain a huge population. A mechanism explaining why agriculture facilitated the emer- 
gence of human groups whose size gradually increased during the last 10 thousands years — 
nothing at the human evolution scale — until originating the extremely densely populated 
areas that we inhabit today. Simultaneously, in unfavorable areas, where agriculture was 
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not possible, or simply extremely difficult, like in the rain forest areas, the level of human 
population has been controlled almost at the original levels. 

As aconsequence from Theorem 2.4, if the intrinsic growth rate of the species, measured 
by A, is below the threshold oo, then the inhabiting area cannot support the species u, which 
is driven to extinction. When A € (00, 01), then the inhabiting area is able to maintain the 
species u around the critical level 1,2], independently of the size of the initial popula- 
tion ug. So, §2 cannot maintain an arbitrarily large population. Therefore, (1.1) exhibits a 
genuine logistic behavior if A < 01. 

Quite surprisingly from the mathematical point of view — for a reason to be explained 
in Section 8 — in the interval A € [o), 02) the population must be limited in the region 
2\ 20, 1, while, as an effect from dispersion to the less hostile region §20,1, the population 
can grow arbitrarily within §29,1. Thus, (1.1) exhibits a sort of logistic growth in £2 \ 20, 1 
and a genuine exponential growth in S29; if 4 € [o1, 02). Indeed, thanks to the parabolic 
maximum principle, 


uy :=Up,ay(, 1; uo) > 0 
and, for each t > 0, 
up, alC,t + 1; uo) = up,ayGs ts U1) > Upa,ao 165 65 41), (2.17) 


where W[,,,.29,,](%, t; 41) stands for the solution of the linear problem 


s — Au=Au_ in 20,1 x (0,00), 
u=0 on 029,1 x (0, 00), vas 
u(-,0) =u4 in §20,1, 


which is given by 
in hietae OE: (2.19) 


Now, suppose A > o; and denote by go, the principal eigenfunction associated with 
o[—A, 92,1]. Then, since u; > 0, there exists w > 0 such that 


uy, > aP0,1 


and hence, it follows from (2.17) and (2.19) that 


t(A+A) (A—o1)t 


upr,a|C,t +1; uo) > ae 90,1 = ae (0,15 
which shows the exponential growth of the population within £291. 

Similarly, when A > 02 the population must be controlled within §2_, as a result of the 
limitation of the natural resources available there in, though the individual of the species 


can disperse to the most favorable areas §29,1 and (29,2, where the population density can 


226 J. Lopez-Gomez 


be arbitrarily large; actually growing at the respective rates e*—°)) and e!*—%), Conse- 
quently, the principal eigenvalues o; and o2 might be though as sort of measuring parame- 
ters of the quality of each of the refuge patches of the environment. 


3. Some general pivotal results 


The following characterization of the strong maximum principle goes back to [53] and [43] 
(cf. [48] for an extremely sharp version of the theorem). 


THEOREM 3.1. Suppose D is an open subdomain of RN, N > 1, with smooth boundary 
and V € C#(D). Then, the following assertions are equivalent. 

(a) o[-A+ V, D] > 0. 

(b) There exists a function h € C?(D)C(D) such that h > 0 in D, 


(-A+V)h>0 inD, 


and either h|jp > 0, or (—A+ V)h > 0 in D — sucha function h is called a positive strict 
supersolution of —A + V in D under Dirichlet boundary conditions. 

(c) The operator —A + V satisfies the strong maximum principle in D, i.e., for every 
f €C#(D), g €C?+# (aD), such that f > 0, g > 0, (f, g) ¥ (0, 0), and any u € C2+#(D) 
satisfying 


(-A+V)u=f inD, 
Uu=g on 0D, 


one has that u >> 0 in D. 


Throughout the remaining part of this section we suppose f € C/(2 x [0,00)) and 
consider a smooth subdomain D of §2 such that 


DNQ_#9%. (3.1) 


As an immediate consequence from the abstract theory developed by Amann in [1] and [2], 
the following result holds. 


THEOREM 3.2. Suppose g € C*+#(aD) and 


| —Au=hu—af(-,u)u in D, (3.2) 


u=g on 0D 


possesses a subsolution u € Catt (D) and a supersolution u € C7t+H(D) such that u <u. 
Then (3.2) possesses a solution u € C?+#(D) such that 


ucucu. 


Moreover, (3.2) has a minimal and a maximal solution in [u, u]. 
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Note that if wu (resp. w) is a strict subsolution (resp. supersolution) of (3.2), then any 
solution u of the problem in [ uv, uv] must satisfy u <u <u (resp. u <u <2). 
AS an easy consequence from Theorem 3.2, the following result holds. 
THEOREM 3.3. Suppose u, u € C*+#(D), satisfy 
—Au<hu-af(.,u)ju and —Au>ru—af(.,uju inD, 
lim u(x)=oco and lim u(x)=~nH, 
dist(x,9D)J0— dist(x,9D) 0 
and 
u<u inD. 
Then, the singular boundary value problem, 


Pe aa in D, (3.3) 


u=oo on 0D, 
possesses a solution u € C?+#(D) such that u <u <i. 


PROOF. For each sufficiently large n > 1, say n > no, we consider 
: 1 
Dn := 4x € D: dist(x,dD) > —}. 
n 


The integer np > 1 must be chosen so that 0D, inherits the regularity of 0D. Thanks to 
Theorem 3.2, for each n > no, the problem 


—Au=hu-—af(-,u)u in Dy, 


u= a on dD, 


possesses a solution uy € C+ (D,) such that 
ulD, <Un <Ulp, in Dn. 

Thanks to these estimates, there exists a subsequence {Un,, }m>1 Of {Un}n nq Such that 
Tim [lnm — Hollc2+1(Dyy) = 9 

for some solution ug € C?+"(Dy,) of 


—Au=hu-—af(,uju in Dag, 


_ utu 
u= =z on IDny- 
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Now, consider the new sequence {un,, | Dra }m>1- The previous argument also shows the 
existence of a subsequence of {Uy,, Dug +1 }m>1, labeled again by n,,, such that, for some 


uy €C7*# (Dag), 
Tim [lng — lh e24# yy er) = 9- 
Necessarily, u1|p,, = “o. Repeating this procedure infinitely many times, the point-wise 


limit of the diagonal sequence provides us with a solution of (3.3) satisfying all require- 
ments. 


The following result collects some important properties that are going to be used 
throughout the remaining of this work. 


LEMMA 3.4. Suppose f satisfies (Af), g €C?*#(9D), g >0, and ii €C**"(D), i > 0, 
is a supersolution of (3.2). Then, u > 0, i.e., u(x) > 0 for each x € D and F(x) <0 


for each x € i~'(0) NAD, where nx stands for the outward unit normal at x € 9D. In 
particular, any positive solution u of (3.2) satisfies u >> 0. Moreover, 


o[-A-A+af(.,a), D] >0. 
Actually, if g =0 and u is a solution of (3.2), then 

A=a[-A+af(.,i), D]. (3.4) 
Furthermore, for each x > 1, ku also provides us with a supersolution of (3.2). 
PROOF. Since u|jp > 0 and 

(-A - A+ af (-,i))it 20 inD, 
u > 0 provides us with a positive supersolution of —A — A+ af(-,u) in D under Dirichlet 
boundary conditions, and two different situations can occur. 

If either g > 0 on 0D, or g = 0 on OD but u is a positive strict supersolution of 
—A—d+af(-,u) in D under Dirichlet boundary conditions, then it follows from Theo- 
rem 3.1 that 

o[-A-A+af(.,a),D]>0 (3.5) 
and u > 0. 
If g =0 on OD and uw is not a strict supersolution of -A — A+ af(-,u) in D, then 


u provides us with a positive eigenfunction associated with the principal eigenvalue 


o[-A—A+af(.,a), D] =0 (3.6) 
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and hence, by Krein—Rutman theorem, u > 0. Note that in such case u is a solution of (3.2) 
and that (3.4) holds from (3.6). 
Now, pick « > 1. Then, 


kulap 2 Ulap 2 8, 
and, in D, we have that 

—A(ku) > Aku —af(.,u)ku > drku —af(.,Ku)KuU, 
since, by (Af), 


fC, Ku) > fC, 4), 


which concludes the proof. 


The following theorem will extraordinarily simplify the mathematical analysis of the 
next sections. 


THEOREM 3.5. Suppose f satisfies (Af), g €C?+#(AD), g > 0,4 >o[—A, D] if g=0, 
and (3.2) possesses a supersolution u > 0. Then, (3.2) has a unique positive solution. 
Moreover, if we denote it by 6{),p,9|, then for any positive subsolution (resp. supersolution) 
u (resp. u) of (3.2), one has that u < O1,D,g) (resp. O[a,D,g] <u). Furthermore, for each 
ug > 0, 


a I]“ia.D.91¢, #5 uo) — Op.,d.8Ille py = 9: (3.7) 


where uyy,D,g|(X, t; uo) stands for the unique solution of the parabolic problem 


o _ Au=dAu—af(-,u)u in D x (0, 0), 
u=g on 0D x (0, 00), (3.8) 
u(-,0) =u9 in D. 


Suppose (Af), (3.2) has a supersolution u > 0, g =0 and X < o[—A, D]. Then, (3.2) 
cannot admit a positive subsolution and 


bie lura,d, 21 t; Uo) lew) =0. (3.9) 


PROOF. In case g > 0, u := 0 provides us with a strict subsolution of (3.2), and hence, 
(0, w) provides us with an ordered sub-supersolution pair. Thus, thanks to Theorem 3.2, 
(3.2) possesses a solution 0 < u < u. Due to Lemma 3.4, u > 0. 

Suppose g = 0 and A > o[—A, D]. Let g > 0 denote any principal eigenfunction as- 
sociated with o[—A, D]. Then, for each sufficiently small ¢ > 0, the function u := eg 
provides us with a positive strict subsolution of (3.2). Indeed, ¢g|gp = 0 and, in D, 


—A(eg) =eo[—A, Dlg <r€9 — af, egyeg 
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for sufficiently small ¢ > 0, since o[—A, D] <A and 
rin |]afC. eg) lew) = 0. 


Fix one of these values of ¢. Due to Lemma 3.4, u >> 0 and xu is a supersolution of (3.2) 
for every « > 1. Pick a sufficiently large k > 1 so that 


ED <KU. 


Then, (€g, xu) provides us with an ordered sub-supersolution pair of (3.2) and hence, 
thanks to Theorem 3.2, (3.2) possesses a solution u such that 


EY <UKKU. 
Note that, due to Lemma 3.4, u > 0. 

To show the uniqueness of the positive solution of (3.2) we proceed by contradiction. 
Suppose (3.2) has two different positive solutions u; 4 uz. The previous analysis shows 
that there exist e > 0, « > 1, and a strict subsolution 

u € {0, eg} 
such that 


u <min{u1, U2} < max{u1,u2}< Ku. 


Let u, and u* denote the minimal and the maximal positive solutions of (3.2) in [u, Ku]. 
Necessarily, 


u < Uy, <min{uy, u2} < max{uy,u2}<u* <Ku 

and therefore, (3.2) possesses two ordered positive solutions, u, < u*. Setting 
wi=u* —u, > 0, 

the following linear boundary value problem is satisfied 


ery in D, (3.10) 


w=0 on 0D, 


where V is the potential defined by 
1 of 
Vix af ae tu* + (1 —t)u,)(tu* + (1 — tus) dt 
0 u 


1 
+a f(-,tu* + (1 — thus) dt. (3.11) 
0 
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By Lemma 3.4, u* >> 0 and u, >> 0. Hence, it follows from (Af) and (3.1) that 


1 
veaf f(-,tu* + (1 — tux) dt > af (-, ux), 
0 


since u* > ux. In particular, by the monotonicity of the principal eigenvalue with respect 
to the potential, we find that 


o[-A-—A+V, D] >o[-A-—A+af(-, ux), D]. (3.12) 
Thus, thanks to (3.4), (3.12) gives 
o[-A-A+V, D] > 0. 
As the principal eigenvalue is dominant, we conclude from (3.10) that w = 0, which con- 
tradicts w > 0. This contradiction concludes the proof of the uniqueness of the positive 
solution. Subsequently, we denote by 4, p,g] the unique positive solution of (3.2). 
Suppose u > 0 is a subsolution of (3.2). Then, since u > 0, for sufficiently large « > 1, 


we have that u < xu and hence, by Theorem 3.2, (3.2) has a positive solution in [u, Ku]. 
By the uniqueness, u < 61,,p,9] < Ku and, in particular, 


U< OA, D,g1- 

Suppose u > 0 is a supersolution of (3.2). By Lemma 3.4, u > 0. If g > 0, then, u = 0 
provides us with a strict subsolution of (3.2) and, due to Theorem 3.2, (3.2) has a positive 
solution u in [0, u]. By the uniqueness, 

OfA.,D,g] SU. (3.13) 
Similarly, if g = 0, then, for sufficiently small e > 0, wu := e@ provides us with a strict 
subsolution of (3.2). Thus, if ¢ is chosen so that eg < u, by Theorem 3.2, (3.2) has a 
positive solution u in [eg, u]. Therefore, by the uniqueness, (3.13) as well holds. 

Now, we will prove (3.7). First, we suppose that 

g=0 and A>o[-A, D]. 

Since uo > 0, by the parabolic maximum principle, for each t > 0 we have that 


UlA,D,g| >t; uo) > 0. 


Now, pick a sufficiently small ¢ > 0 and a sufficiently large « > 1 so that (eg, ku) be an 
ordered sub-supersolution pair of (3.2) for which 


EY <UA,D, gC, 1; uo) < KU. 
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Note that « > 1 can be chosen so that 
KU > O,D,2), 


and hence, by the uniqueness of the positive solution, ku must be a positive strict super- 
solution. Now, thanks again to the parabolic maximum principle, for each t > 0 we have 
that 
UA, D, gl t3 EY) < Up, D,e)(+ t Ula, Dg], 1; uo) 

= Uy, D,g]C,t + 1; uo) 

<upa,d, gC, 05 Ku). (3.14) 
Moreover, since €¢ is a strict subsolution, as f grows, u{,,p,9](-,t; €¢) increases approxi- 
mating the minimal positive solution of (3.2) in [eg, ku], while, since xu is a strict super- 
solution, u[,,p,¢)(-,t; ku) decreases approximating the maximal positive solution of (3.2) 


in [eg, cu] (cf. [65]). As O,,p,¢) is the unique positive solution of (3.2), passing to the 
limit as t ¢ 09 in (3.14) gives 


Bi U[A,D.g1C.t; U0) =9n,D,¢) inC(D), 


so concluding the proof of the theorem in this case. 
Now, suppose g > 0 and pick a sufficiently large « > 1 for which 


KU > O12.,D,2] and O< UlA,D, gC; 1; ug) <KU. 
Then, arguing as above, we find that 
Ufa, D,g](,t; 9) < upa,D,g] (., ty ua,D,g)Cs 1; uo)) 


= Up,D,g]C,t + 1; uo) 


<Uupa,d, gC, 65 Ku), (3.15) 


and similarly, (3.7) follows by passing to the limit as ¢ ¢ 00 in (3.15). 
Finally, suppose 


g=0 and A<o[—A,D]. (3.16) 


We claim that (3.2) cannot admit a positive subsolution; in particular, it cannot admit a 
positive solution. To prove this feature we proceed by contradiction. So, suppose (3.2) 
possesses a positive subsolution u > 0. Since u > 0, there exists k > 1 such that u < Ku 
and therefore, due to Theorem 3.2, (3.2) possesses a positive solution u. Moreover, thanks 
to Lemma 3.4, we have u > 0 and 


A=a[-A+af(.,u), D]. 
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Since u > 0, it follows from (Af) and (3.1) that af(-, u) > 0in D and hence, thanks to the 
monotonicity of the principal eigenvalue with respect to the potential, 


A=oa[-A+af(-,u), D] > o[-A, D], 


which contradicts (3.16). Therefore, (3.2) cannot admit a positive subsolution in such case. 
In order to show that, under (3.16), condition (3.9) is satisfied, we consider x > 1 such that 


0 < upp, g]C, 1; uo) < Ku. 
Then, for each t > 0, we have that 

0 <upa,p,g1¢,t +15 uo) < upp, g|(, t5 Ku). (3.17) 
As «xu is a supersolution of (3.2), up,,p, 91, t; Ku) decreases approximating as ft + co the 


maximal nonnegative solution of (3.2) in [0, <u], which is the zero solution. Therefore, 
passing to the limit as ¢t ¢ 00 in (3.17) shows (3.9) and completes the proof. 


Actually, the following strong comparison result is satisfied. 
LEMMA 3.6. Suppose f satisfies (Af), g € C°t#(AD), g >0, A > o[—-A, D] if g=0, 
and (3.2) possesses a supersolution u > 0. Then, for any positive strict subsolution (resp. 
supersolution) u (resp. u) of (3.2), one has that u K ,,p,2] (resp. 9a,D,2] K u), where 
11, D,¢] 8 the unique positive solution of (3.2). 


PROOF. Suppose u > 0 is a strict subsolution of (3.2). Then, due to Theorem 3.5, 
u < O4,D,g], and therefore, 


u<O,,D,91> 
since u cannot be a solution. Consequently, 

Ww = O,D,2) — u > 0. (3.18) 
Now, adapting the uniqueness argument of the proof of Theorem 3.5, it readily follows that 


cae in D, (3.19) 


w>0 on 0D, 


where V is the potential defined by 


1 

) 

Vix af ~(., t0,,D,9) + (1 — t)u) (tOf,,p,91 + (1 — t)u) de 
0 


1 
+a f(-, t0,,0,¢) + A — tu) de. 
0 
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Now, we have to distinguish between two different situations. If w|gp > 0, then w > 0 
provides us with a positive strict supersolution of —A — 4+ V in D under homogeneous 
Dirichlet boundary conditions. Thus, due to Theorem 3.1, w >> 0 in D, and therefore 
UK y,D,9]. Now, suppose w|ap = 0. Then, w > 0 is a principal eigenfunction associ- 
ated with 


o[-A—A+V, D]=0 


and, due to Krein—Rutman theorem, w > 0, which concludes the proof. 


4. The classical logistic equation. A priori bounds in 2_ 
In this section we analyze the dynamics of 


s _ Ay =)u—a(x)f(x,u)u in D x (0,00), 
u=M on dD x (0, co), (4.1) 
u(-,0) =u9 > O in D, 


where M €é [0, co) is aconstant, D is a smooth subdomain of {2 such that 
DIG Qa; (4.2) 


and f satisfies (Af) and (Ag). The main result establishes that the dynamics of (4.1) is 
governed by its maximal nonnegative steady-state, which is the maximal nonnegative so- 
lution of 


ae eee in D, (4.3) 


u=M on oD. 


Actually, for each M > 0, (4.3) possesses a unique positive solution which is a global 
attractor for the solutions of (4.1). Throughout the rest of this paper it will be denoted by 
61.,D,My]- It turns out that this solution satisfies 


lim 62.,p,mM)=0 ifa<o[—A, D], 
M\0 


while 


012,D,0] ‘= tim 62.,D.m) ifXA >o[—A, D], 


provides us with the unique positive solution of (4.3) for M = 0. So, there is a continuous 
transition between both dynamics as M perturbs from zero. 

The analysis of (4.1) in case D C Q_ is much easier than the analysis of the general 
case when (4.2) is satisfied, where a might partially, or totally, vanish on 0D, as a result of 
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the fact that sufficiently large positive constants provide us with supersolutions if D C Q_, 
while no positive constant can be a supersolution if a vanishes on 0D and A > 0. Thus, 
in the first two sections we will focus our attention into the simplest case when D C Q_. 
Then, in Section 4.3, we will assume that, in addition, f satisfies (Ah) in order to refine the 
classical a priori bounds of Keller [38] and Osserman [61]. These bounds will allow us to 
obtain the existence of a minimal and a maximal positive solution for the singular problem 


—Au=hu—a(x)f(x,u)ju in D, (4.4) 


u=0o on oD. 


As a consequence from these bounds, it will be apparent that 
O12, D,0o] := lim 01.,D,M] 
M*too 


provides us with the minimal positive solution of (4.4). Finally, in Section 4.4, these results 
will be used to study the general case when condition (4.2) is satisfied. The following 
consequence from Lemma 3.4 will be very useful. 


LEMMA 4.1. Suppose u € C?+H#(D), u > 0, is a solution of (4.3) for some M € [0, 00). 
Then u > 0. Moreover, 


A=o[-A+af(-,u), D] (4.5) 


if M =0. In case M = ~, any solution u € C?+#(D), u > 0, must satisfy u(x) > 0 for all 
xeéeD. 


PROOF. The fact that u >> 0 for any positive solution of (4.3) with M € [0, 00) is a conse- 
quence from Lemma 3.4, and (4.5) is a consequence from (3.4). 

Now, suppose M = oo. Then, u provides us with a positive supersolution of 
—-A-—i+af(.,u) in any subdomain of the form D, := {x € D: dist(x, dD) > 1/n}, for 
sufficiently large n, and hence, thanks again to Lemma 3.4, u >> 0 in D,, which concludes 
the proof. 


4.1. The classical logistic equation: M =0 and DC Q- 


The following result provides us with the existence and the uniqueness of the positive 
solution to (4.3) in this case. Note that 


a_,p:=mina > 0. (4.6) 
D 


THEOREM 4.2. Suppose DC Q_, M =0, and f satisfies (Af) and (Ag). Then, (4.3) 
possesses a positive solution if and only if X > o[—A, D]. Moreover, it is unique, and 
strongly positive, if it exists. Furthermore, if we denote it by ®),p,0| and uj, p,0\(X, t; Uo) 
stands for the unique solution of (4.1), then 
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(a) limytoo Ufa, D,0)(¢, #3 U0) = 0 in C(D) if <o[—A, D]; 
(b) lim; poo Ufa, D,0) (-, £3 Mo) = Oa,D,0] in C(D) ifrA > o[—A, D]. 


PROOF. It is a direct consequence from Theorem 3.5, since sufficiently large positive con- 
stants provide us with positive supersolutions of (4.3), by (Ag). 


The following result establishes that the set of positive solutions of (4.3) consists of a 
differentiable curve emanating from u = 0 at the value of the parameter A = o[—A, D], 
where the attractive character of the steady state u = 0, as a solution of (4.1), is lost. 


PROPOSITION 4.3. Suppose D C Q_, M=0, and f satisfies (Af) and (Ag). Then the 
solution map 


(of-A, D], 00) > C(D), 


(4.7) 
A> O(A) := O1,D,0] 
is of class C! and point-wise increasing. Actually, 
O(A)>O(u) ifk>u>ol-A, DI. 
Moreover, 0(A) bifurcates from (A, u) = (A, 0) atA = o[-A, D], i.e., 
O(a) =0. (4.8) 


lim 

ALo[—A, D] 
PROOF. The solutions of (4.3) are the zeros of the nonlinear operator 

5:R x Co(D) > Co(D) 
defined by 

FA, u):=u—(—A) [Au — af (, wu], 
where (— A)~! stands for the resolvent operator of — A in D under homogeneous Dirichlet 
boundary conditions. The operator % is of class C! and, by elliptic regularity, F(A, -) is a 
nonlinear compact perturbation of the identity for each A € IR. Moreover, 

§A,0)=0, AER, 
and, for each (A, v) € R x Co(D), 

DuB(A, 0)u =u — (—A)! (Au). 


Thus, D,§(A, 0) is a Fredholm analytic pencil of index zero whose spectrum consists of 
the eigenvalues of —A. In particular, 


N[D.u3(o[—A, D],0)] = span{g], 
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where ¢ > 0 is any principal eigenfunction of o[—A, D]. We claim that 
D;, Dy 8(ol—A, DI, 0)¢ ¢ R[Dus(ol—A, DI], 0)]. (4.9) 


Consequently, the transversality condition of Crandall and Rabinowitz [19] holds true. To 
prove (4.9) we proceed by contradiction assuming that 


D,Dy8(ol—A, D],0)g = —(—A) “9 € R[D,3(o[—A, D], 0)]. 
Then there exists u € Co(D) such that 

u—(—A)!(o[-A, DJu) = —(-A) 9. 
By elliptic regularity, u € Coe (D) and 

(—A —o[-A, D])u=~—g@. 
Multiplying this equation by ¢, integrating in D and applying the formula of integration by 
parts gives [ D ¢* = 0, which is impossible. This contradiction shows the validity of (4.9) 
and therefore, by the main theorem of [19], (A, uw) = (o[—A, D], 0) is a bifurcation point 
from (A, u) = (A, 0) to a smooth curve of positive solutions of (4.3). By the uniqueness of 
the positive solution, as a result from Theorem 4.2, (4.8) holds true. 


Subsequently we suppose that (A, uw) = (Ao, uo) is a positive solution of (4.3). Then 
S(Ao, uo) = 0 and, by Lemma 4.1, uo >> 0 and 


Ag =o[—-A +af(-, uo), D]. (4.10) 


Differentiating with respect to u we have that, for each u € Co(D), 


DuB(Ao, uo)u =u —(—A)! [ao — al, ug)ugu —af(-, wu, 


In particular, D,%(Ao, uo) is a Fredholm operator of index zero. Moreover, it is a linear 
topological isomorphism, since it is inyective. Indeed, if there exists u € Co(D) for which 


0 
u—(—A)"! ou = ant, ug)ugu — af (-, wo] =0, 
u 
then, by elliptic regularity, u € cate (D) and 


(-8-d0-4a 26, nono arto) )w=0 in D. (4.11) 
u 


238 J. Lopez-Gomez 


On the other hand, thanks to (4.10) and (Af), we have that 


0 
a[-a —ho+ as, ug)uo + af(-, uo), D| 
> o[-A —dAo taf (-, uo), D] =0. 

Consequently, it follows from (4.11) that u = 0. Therefore, Dy §(Ao, uo) is a linear topo- 
logical isomorphism, and the uniqueness of the positive solution, as a consequence from 
Theorem 4.2, combined with the implicit function theorem shows the regularity of the 
map 6 defined by (4.7). Finally, differentiating the identity 

5(A,0()) =0, A>o[-A, D], 


with respect to A gives 
-1 af 
D),@ = (—A) Eee a Cee ay eae 
u 


or equivalently, 


af eye + af(6)) Dib =8. 
ou 


(-a-a+0 
As 0 > 0 and for each 1 > o[—A, D], 
of 
oO Shire Meare) eP > 0, 
u 
it follows from Theorem 3.1 that 


-l 
Dj O(A) = (-a —A +aH(, O(A))O(A) +af (-, 00)) 0(A) > 0, 


which concludes the proof. 


Note that if A > pp > o[—A, D], then ,,,p,0] 18 a strict subsolution of (4.3) and there- 
fore, the relation 0, p,0] < 9,,p,0) also follows from Lemma 3.6. 

In Figure 4 we have illustrated the results from Theorem 4.2 and Proposition 4.3. For a 
given value x € D, we have represented the curve 


AR O12, D,0] (x). 
It bifurcates from the horizontal axis at the value of the parameter A = o[—A, D] and it 


increases for all further values of 2. The direction of the arrows indicate the flow of (4.1). 
According to Theorem 4.2, as time grows to infinity uj, ,p,0)(%, t; uo) decays to zero if 
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9.0} 


rt 


Fig. 4. The dynamics of (4.1) in case D C Q— and M =0. 


ol-AD] 


A <o[—A, D], whereas it approximates 4, p,o](x) if A > o[—A, D]. It should be noted 
that the trivial steady-state u = 0 of (4.1) is linearly stable if A < o[—A, D], while it is lin- 
early unstable if A > o[—A, D]. Hence, the stability lost by u = 0 as A crosses o[—A, D] 
is gained by the positive solution 61, p,0) bifurcating from u = 0 at o[—A, D], in complete 
agreement with the exchange stability principle of Crandall and Rabinowitz [20]. 


4.2. The case M>Oand DC Q_ 


In this case, as an immediate consequence from Theorem 3.5, the next result holds true, 
because sufficiently large positive constants are supersolutions of (4.3). 


THEOREM 4.4. Suppose D C Q_, M >0, and f satisfies (Af) and (Ag). Then, for each 
AER, (4.3) possesses a unique positive solution. Moreover, it is unique and strongly posi- 


tive if it exists, and if we denote it by ®),,p,m\ and uy, p,m\(X,t; Uo) stands for the unique 
solution of (4.1), then 


lim up,payGot u0) =2,p,m)_ inC(D). (4.12) 


Further, thanks to Lemma 3.6, the following comparison result holds true. 


LEMMA 4.5. Suppose D C Q_, M > 0, and f satisfies (Af) and (Ag). Let u > 0 (resp. 
u > 0) be a strict subsolution (resp. supersolution) of (4.3). Then 


u<Oa,D,M]_ (resp. 0,,p,m] Ku). 
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Consequently, the estimates 
0<M, <M. <a, —00 <hj <A2< ~W, Mz — M,+A2—-—A, >0 
imply 
Afa1,D,Mi] K Pa2,D,Mo- 
Moreover, for each Xx > o[—A, D] and M > 0, 
10,0] < Or,D,M1- 
As a consequence from Lemma 4.5, the point-wise limit 


6, D,0o] = a 6.D,.M) in D (4.13) 


is well defined, though, without any further assumptions on f, it might be everywhere 
infinity. In the next section we shall see that (4.13) provides us with the minimal positive 
solution of (4.4) if, in addition, f condition (Ah). Actually, (Ah) is not only sufficient but 
also necessary for that, though this issue is outside the scope of this work. 

The next result shows the structural stability of model (4.1) under perturbations of the 
parameter M e [0, ov). 


PROPOSITION 4.6. Suppose D C Q_ and f satisfies (Af), (Ag). Then 


0 ifA <o[—A, D], 


lim 0 — 
MO sD At) oa ifA>o[—A, D]. 


PROOF. As a consequence from Lemma 4.5, the point-wise limit 
(ony := lim 012.,D,M] 
M\0 


is well defined. Moreover, by the Schauder theory (e.g., [33]), it is easy to see that Oo pro- 
vides us with a classical solution of (4.3) for M = 0. Necessarily, @g > 0. Thus, thanks 
to Theorem 4.2, Op = 0 if A < o[—A, D], while, in case A > o[—A, D], it follows from 
Lemma 4.5 that ©9 > ,,p,0) and therefore, by the uniqueness of the positive solution, 
Oo = 42.,.D,0], Which concludes the proof. 


Thanks to Proposition 4.6, the curve of maximal nonnegative solutions of (4.3) for 
M =0 perturbs into the curve of positive solutions of (4.3) when M > 0 separates away 
from M = 0. In Figure 5 we have fixed M > 0 and represented the curve 


At 6n,D,m] (x) 
for a generic x € D, as well as the flow of (4.1). As M | 0 the curve approximates 0 


if A < o[—A, D], and 6,,p,0)(x) if A > o[—A, D]. Figure 5 should be compared with 
Figure 4; the dashed lines represent the nonnegative solutions of (4.3) with M =0. 
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are DMI (x) 


A 


o[-A,D] 
Fig. 5. The dynamics of (4.1) in case D C Q_ and M > 0. 
4.3. The radial case M = 00 and D = Br(xo) with DC Q_ 
Subsequently, given xo € RY and R>0, Br (xo) stands for the open ball 
Br(x0) := {x eR: |x — xo| < R}. 
The main result of this section is the following proposition. 


PROPOSITION 4.7. Pick 4 € R, x9 € 2 and R>0 such that D C Q_, where D := 
Br(xo), and suppose f satisfies (Af) and (Ag). Consider the auxiliary function 


H(u):=az, pg(u)u—du, ue€é[0,oo), (4.14) 


where arp is given by (4.6), and let u), denote the unique positive zero of H(u). Suppose, 
in addition, that 


0° s —1/2 
I(u) =i |/ A(z) a:| ds<oo foreachu> uj, (4.15) 


and 


lim [(u) =0. (4.16) 
usoo 


Then, the point-wise limit (4.13) is finite in D, and it provides us with the minimal positive 
solution of (4.4). 


PROOF. Thanks to Theorem 4.4, for each M > 0, (4.3) has a unique positive solution, 
which has been already denoted by 61, p,m}. By (Ag), a,p,m] provides us with a positive 


242 J. Lopez-Gomez 


subsolution of the auxiliary problem 


—Au=—H(u) in D= Br(x0), (4.17) 


u=M on oD. 


Thanks again to Theorem 4.4, (4.17) possesses a unique positive solution. Let denote 
it Oy. By Lemma 4.5, we have 


O4,D,M] <@m_ foreach M > 0, (4.18) 
and 

Ou, <K<Oy, if0< M, <M. 
Thus, the point-wise limit 


Oo := lim Oy (4.19) 
M*tco 


is well defined in D. Consequently, due to (4.18), in order to prove that the point-wise limit 
(4.13) is finite in D it suffices to show that © is finite in D. 

Since (4.17) is invariant by rotations, ©, must be radially symmetric for each M > 0. 
Hence, 


Ou(x)=Wu(r), ri=|x —xol,x € D, 


where Wy is the unique positive solution of 


wi(r)+ WN =H(v@), O<r<R, 


4.20 
W'0)=0, W(R)=M. oo 


Indeed, the function wy := 0 is a subsolution of (4.20) and w := C is a supersolution 
of (4.20) for each sufficiently large C > M. Thus, (4.20) has a positive solution, since 
w < W; necessarily unique, because otherwise we would contradict the uniqueness of the 
positive solution of (4.17). Throughout the remaining of the proof, without lost of general- 
ity, we may assume that 


M>u,. 


For this choice, as u := uy, is a positive strict subsolution of (4.17), we find from Lemma 4.5 
that 


ux, < Oy(x)=Wu(r) foreach x € D (4.21) 
and, consequently, 


H(Wu(r)) >0 foreach r € [0, R], (4.22) 
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since H(z) > 0 for each z > uy. Also, for each z > uy, 


H'(z) = ar, pg(z) +41, pzg' (z) — A 
> aL,pg(ua) —A+ aL, Dz8 (Z) 


= az, pzg' (z) > 0 


since H(u,) = 0. Thus, H is increasing in (uj, oo). 
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Now, multiplying the y-differential equation by r’—! and rearranging terms gives 


(rN wiry)’ = rl H(Wy(r)), O<r<R. 


Hence, integrating (4.23) in (0,1), yields to 


Wyner | s\-!H(Wy(s)) ds >0, re (0, R), 
0 


(4.23) 


(4.24) 


where we have used (4.22), which, in particular, shows that r > Wy (r) is increasing, as 


wellasrt> H(Wy(r)). Thus, it follows from (4.24) that 


yr) <r!’ A(Wu(r)) Le ds = SH(Yu(r)), O<r<R. (4.25) 


Now, note that (4.25) gives 
N-1 N-1 
H (Ya (r)) = Vig (r) + —— Py) < Yin) + —H (Yu) 
and hence, 


W 
wir) > me O<r<R. 


Similarly, since Yj, > 0, we find that 
wir) < H(Wu(r)) 
and therefore, 


H(Yu(r)) > Wir) > “ue, O<r<R. 


We now multiply (4.26) by Wu (r) an integrate in (0, r) to obtain 


Vy (r) >. 2 r&u® 
2f H(z) dz > [Wy (r)] >of H(z)dz, O<r<R. 
Wy (0) N Jw (0) 


(4.26) 


(4.27) 


244 J. Lopez-Gomez 


Thus, taking the square root of the reciprocal of (4.27), multiplying by W;, and integrating 
the resulting expression in (r, R) shows that 


u —1/2 N M 
/ i] du < / 
Wy (0) 2 Juu(r) 


IN 
> 
| 
be 
IN 
| 


u -1/2 
/ H du 
Wu (0) 


(4.28) 


1 M 
/2 be 


for each r € [0, R). 
Now pick r € [0, R). Then, for each M > uy, we have that Wy(r) > Wy (0) and hence, 
for each u > Wy (r), 


u u 
| ees nee: 
Yu (0) Yu (r) 


Thus, it follows from the second inequality of (4.28) that 


NM u -1/2 
o<r-r<J> [ | i] du 
2 Jun LJ uur) 
In fx u —1/2 
< =f If a] du 
2 Jwy(r) LJ uur) 
[N 
= x (Ym(r)) < 00 


because of (4.15). Therefore, due to (4.16), we find that 


oa Wu lr) < ©. (4.29) 


This shows that ©. in finite in D. Actually, setting 


Woo(r) = Fae Yu(r), reé[0,R), 


the monotone limit defined through (4.19) is given by 
Oo (x) = Woo (lx _ xol), xeD. 


Moreover, by the continuous dependence with respect to the initial values, Y (7) must be 
the unique solution of the Cauchy problem 


Win+]wO=A(v(r)), O<r<R, 
¥0)=% (0),  w'()=0, 
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and 


ae Woo (r) = co. 
Consequently, @go is a radially symmetric positive solution of 


| —Au=—H(u) in D= Br(xo), (4.30) 


u=0o on oD. 


Actually, @59 provides us with the minimal positive solution of (4.30), as it will become 
apparent later. 

Since Ooo is finite in D, it follows from (4.18) and (4.19) that the function 1), ,00] 
defined through (4.13) is finite in D. Now, pick ¢ € (0, R/2). Then, thanks to (4.18), for 
each M > 0, 

011.,D,M] < oo in BR—¢(X0) 
and hence, by Shauder’s estimates, there is a constant C(¢) > 0 such that 

pa... myllc2+# Bp_re(xo)) < Ce) foreach M > 0. 
Thus, combining the compactness of (—A)~! with the uniqueness of the point-wise 
limit (4.13), we find that 0[,,p,00] € C2+#(Br_2-(xo)) must be a solution of (1.9) in 
Br—2¢-(xo) and that 


Pie I|9f2.,D,M1 — 2, D, col llC(Bp_e(x9)) = 9: 


As this holds true for any sufficiently small ¢ > 0, 1, p,oo) must solve (4.4). Actually, it 
is the minimal positive solution of (4.4). In particular, Ooo is the minimal positive solution 
of (4.30). Indeed, let L be any positive solution of (4.4). Then, for each M > 0, there exists 
aconstant C > M and a sufficiently large n € N such that 

On,D,.M)<C<L in D\ Bp_1 (xo). (4.31) 
Thanks to Lemma 4.5, (4.31) implies 

f.,D,M] < a,D,,.c) <b in Dy := Bp_1 (x0) 
and, consequently, for each M > 0, 

01.,D,M] < L inD. (4.32) 


Finally, passing to the limit as M 4 00 in (4.32) we find that 


012.,D,co] < L, 
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which shows the minimality of ,,,p,00) and concludes the proof. 


4.4. The case M=co and DC Q_ with DC Q_ 


As a consequence from Proposition 4.7 the following result is satisfied for a general domain 
D such that D C 92_. 


PROPOSITION 4.8. Suppose D C Q_ and f satisfies (Af), (Ag) and (Ah). Then, for each 
A ER, the point-wise limit (4.13) is finite in D and it provides us with the minimal positive 
solution of the singular problem (4.4). Moreover, for any positive solution u € C2(D)N 
C(D) of (1.9) in D one has that 

U<AA,D,oo] in D. (4.33) 
PROOF. Pick x9 € D and R > 0 such that Br (xo) C D, and set, for each M > 0, 


QAy:= max 04.,D,M]- 
9 Br(xo) 


Then, thanks to Lemma 4.5, for each M > 0 we have that 

O12.,D,M] < Oa, Be(xo).am+1] mM Br(xo), 
and hence, by Proposition 4.7, 

01.,D,M] <K O12, Br(xo).00] <co in Br(Xo). 
Therefore, passing to the limit as M ¢ oo, shows that 

A[a.,D,00] S Pfr, Br(xo).co] < CO in Br(x0). (4.34) 
As (4.34) holds true in a small ball around each point xo € D, ,,p,oo] must be finite in D. 
Moreover, for each compact subset K C D there exists a constant C(K) > 0 such that, for 
each M > 0, 

612.,D,M] <C(K) mK. 
From these a priori estimates, adapting the last steps of the proof of Proposition 4.7, it is 
easy to see that 01, D,0o] € C?+#(D) must be the minimal positive solution of the singular 
problem (4.4). 


To prove (4.33), let u € C?(D) NC(D) be a positive solution of (1.9) and set 


Qa i= mMaxu. 
aD 
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Then, foreach M >a, 

u<M = 6,D,M] in 0D, 
and hence, thanks to Lemma 4.5, we find that 


u<6p,D,M] <9p,D,0c] in D, 


which concludes the proof. 


4.5. The general case M € (0, 00] and DC Q_ 


The next result extends Theorem 4.4 to cover the general case when D C §2_. Note that, 
in this case, a(x) might vanish on some piece of 0D. 


THEOREM 4.9. Suppose DC 2_, M > 0, and f satisfies (Af), (Ag) and (Ah). Then, 
(4.3) possesses a unique positive solution for each d € R. Moreover, it is strongly posi- 
tive and, if we denote it by 0p,m), then the unique solution of (4.1), up,.,p,m\(x, t; uo), 
Satisfies (4.12). 


PROOF. Subsequently, for each sufficiently large n € N, say n > no, we consider the sub- 
domain of D defined by 


1 
Dy := {x € D: dist(x, dD) > “| (4.35) 
n 


Then, for each n > no, 


Dn C Dati CDC Q_, aL.p, = mina >0 (4.36) 
Dn 
and 
lee) 
D= U Dn. (4.37) 
n=Nno 


Due to (4.36), Theorem 4.4 guarantees that 6[,, p,m] is well defined; recall that 0:,,p,,] 
stands for the unique positive solution of 


—Au=hu-—af(-,u)u in Dy, 
u=M on dDy,. 


Also, thanks to Proposition 4.8, for each n > no, the point-wise limit 


9[A,Dn,oo] = rie O12, Dn, M] 
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8D 8Dnam 8D py 8Dpy, SDnam —s 8D 


Fig. 6. The positive solutions of (4.38) for large M. 


is finite and it provides us with the minimal positive solution of the singular problem 


—Au=dAu—af(-,uju in Dp, 


u=o on 0Dy. 
Moreover, for each n > no and m > | (see Figure 6), 
912, Dn+m,.M] K 92, Dy4m.co] K 9[2,Dn,co] 10 Dn. (4.38) 


In particular, due to (4.37), for each compact subset K C D there exists a constant 
C(K) > 0 and an integer nx € N such that, for each M > Oandn >nx, 


On, Dn,M] S&S <C(K) in K. (4.39) 


From (4.39), a diagonal argument combined with the compactness of (—A)7!, shows the 
existence of a positive solution of (4.3), denoted by @,,p,mj. As the positive solution 
11, D,m] itself provides us with a positive supersolution of (4.3), the remaining assertions 
of the theorem follow as direct consequences from Theorem 3.5. 


Also, thanks to Lemma 3.6, the following counterpart of Lemma 4.5 holds true. 


LEMMA 4.10. Suppose DC 2_, M > 0, and f satisfies (Af), (Ag) and (Ah). Let u > 0 
(resp. u > 0) be a strict subsolution (resp. supersolution) of (4.3). Then 


uKOFa,pd,m) (resp. O2,D,M) K 4). 
Consequently, the estimates 


0<M, <M. <«o@, —00 <hj <A2< ~, Mz — M,+A2—-—A, >0 
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imply 
9a1,D,Mi] K 2,D, Mp]: 


Now, we can give the main existence result of positive solutions for the singular prob- 
lem (4.4) in case D C §2_. It should be noted that Theorem 2.1 is a direct consequence 
from it by making the choice D = 2_. 


THEOREM 4.11. Suppose D C 82_ and f satisfies (Af), (Ag) and (Ah). Then (4.4) pos- 
sesses a minimal an a maximal positive solution, denoted by Lay. DI and Lixpp respec- 
tively, i.e., any other positive solution L of (4.4) satisfies 


min <L< pm 
_~ 


[a,D] S [a,D]° 
Moreover, 

Lay = O14.,D,00] (= ae 012.,D,M] (4.40) 
and 

Lik) = Him 42,0,,00] = lim LB", ) (4.41) 


where Dy, n > 1, is the subdomain of D defined by (4.35). 


PROOF. Thanks to Lemma 4.10, the point-wise limit (4.40) is well defined. Now, we shall 
see that it is finite. Pick x9 € D and R > 0 such that 


Br(xo) CDC Q_ 
and set 


Qy i= max O12,D,M]; M>O. 
dBr(xo) 


Thanks to Lemma 4.10, 

A[2,D,M] K ,Be(x0).emt+1] in Br(xo) 
and therefore, for each M > 0, 

O[2,D,M] K Or, Be(xo),00] in Br(X0). 


As this argument is valid for any x9 € D and, thanks to Proposition 4.7, the point-wise limit 
O12, Br(x),co] 18 finite in Br(xo), for each compact subset K C D there exists a constant 
C(K) > 0 such that, for each M > 0, 


O,D,M)<C(K) ink. 
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This shows that the point-wise limit (4.40) is finite in D. Further, combining the 
monotonicity of the involved sequences with the compactness of (—A)~!, it is easy to 
see that 0, D,0o] € C2t+#(D) provides us with a positive solution of (4.4). Actually, it is the 
minimal positive solution. Indeed, let L be any positive solution of (4.4). Then, for each 
M > 0, there exists a constant C > 0 and a sufficiently large n € N such that 

On,D.M)<C<L inD\ Dy. (4.42) 
Also, thanks to Lemma 4.5, (4.42) implies 

O1.,D,M] <fa,D,.c) < Lin Dy 
and therefore, 

O1a,D,M] <L inD. (4.43) 
Consequently, passing to the limit as M ¢ oo in (4.43) we find that 

O1n,D,co] < L 
which shows the minimality of 6, p,o0] aS a positive solution of the singular problem (4.4). 

Similarly, thanks to (4.38) and (4.39), the point-wise limit (4.41) is well defined in D 

and it provides us with a positive solution of (4.4). To show its maximality, suppose L is 


any positive solution of (4.4). Then, for each n > no, there exists M > 0 such that L|p, 
provides us with a positive subsolution of (4.3), and therefore, thanks to Lemma 4.5, 


LS 00:5, 30) = Oi.decoy I Da: 
Consequently, passing to the limit as n ¢ 00 gives 


L<Li"p: 


which concludes the proof. 

In Figure 7 we have sketched the construction of Le) and Lip carried out in the 
proof of Theorem 4.11. Although we conjecture that, under the general assumptions of this 
section, 


Lip) = Lip} 


i.e., the positive solution of (4.4) is unique, we could not get a proof of this fact, except — 
essentially — in the case described by Theorem 2.7. 
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ee, 
a 


8D 8Dnat 8Dpy 3Dp 3Dnat 8D 


pmax 


i DI pLmn 


and [DI]: 


Fig. 7. The construction of 


5. Proofs of Theorems 2.1—2.3 


Theorem 2.1 is a direct consequence from Theorem 4.11. Actually, thanks to Theo- 
rem 4.11, for each 4 € R the following relation is satisfied 


Lito) = slim 4.0. (5.1) 
where 6/,,2_,m] Stands for the unique positive solution of (2.1) with D = 2_. Moreover, 
Lia) = ae Line" (5.2) 
where, for any sufficiently large n € N, 
) 1 
Q” := 4x EQ_: dist(x,dQ_)> —-}. 
n 


Now, we shall begin the proof of Theorem 2.3. First, we will characterize the existence of 
positive solutions of 


coy er in 2, (5.3) 


u=0 on 02. 


Suppose u is a positive solution of (5.3). Then, thanks to Lemma 3.4, u > 0 and 


A=o[-A+af(.,u), 2]. (5.4) 
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In particular, af (-, u) > 0 in Q, and hence, by the monotonicity of the principal eigenvalue 
with respect to the potential, (5.4) implies 


A=o0[-A+af(.,u), 2] > o[-A, 2Q]=00. 


Also, by the monotonicity of the principal eigenvalue with respect to the domain, it is 
apparent that 


A=o[-A +af(,u), 2] <o[-A+af(-,u), 201] =ol-A, 2,11 = 01 
since a = 0 in §20,;. Therefore, condition 

09 < rA< O71 (5.5) 
is necessary for the existence of a positive solution of (5.3). Note that 

09 =0[—-A, 2] < o[-A, Qo 1J=1 
by the monotonicity of the principal eigenvalue with respect to the domain. 

Now, we will show that (5.5) is not only necessary but also sufficient for the existence of 

a positive solution of (5.3). Suppose (5.5). Then, due to Theorem 3.5, to show the existence 
of a positive solution it suffices to construct a positive supersolution of (5.3). Actually, 
thanks to Theorem 3.5, the existence of the positive supersolution itself entails its own 
uniqueness. It should be noted that, thanks to Theorem 3.5, (5.3) cannot admit a positive 


supersolution if A > 01. To construct the supersolution we proceed as follows. For each 
j €{1, 2} and sufficiently small 6 > 0 consider the open 5-neighborhoods 


5, ; = {x € 2: dist(x, 20, ;) < 5}, 


which have been represented in Figure 8. Note that §253,; consists of {29,1, I and the set 
of points x € §2_ such that dist(x, I) < 6. Similarly, (25,2 consists of 20.2 and the set of 
points x € 92_ such that dist(x, I>) < 5. By the continuous dependence of the principal 
eigenvalues with respect to the domain (e.g., [43], Theorem 4.2), we have that 


Hae ere ee 7 =o[-A,2,j]=o;, j€ {1,2}. 


Thus, by the monotonicity of the principal eigenvalues with respect to the domains, it is 
apparent that, for each sufficiently small 6 > 0, 


09 <A <o[—A, 9251] < 01 < o[—A, 23,2] < op. (5.6) 


Metasolutions: Malthus versus Verhulst in Population Dynamics. A dream of Volterra 253 


Fig. 8. The 6-neighborhoods 25 ; and {25 9. 


Fix A € (00, 01) and pick one of these values of 5. Now, for each j € {1, 2}, let gs, ; >> 0 de- 
note a principal eigenfunction associated with o[—A, 25, ;] — unique up to a multiplicative 
constant — and consider the function ® defined through 


951 in 2572.1, 
@ = 4 95,2 in 25/2,2, (5.7) 
g— in 2\ (252.1 U25/2,2), 


where g_ is any smooth extension of 93,1 V @3,2 to 
-_ _ . 6 
2 \ (25/2,1 U 2572.2) = 4x € Q_: dist(x, AQ_) > 5 


that it is positive and bounded away from zero. Note that g_ exists, since @3,; is positive 
and bounded away from zero on 82_ 0825/2, ;, j € {1, 2}. Figure 9 shows a genuine profile 
of @. 

We claim that the function 


i= K® (5.8) 


is a supersolution of (5.3) for each sufficiently large « > 1. Indeed, 


kK®=0 ond 
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O71 - 0,2 = 0,1 
Fig. 9. The profile of the supersolution element ®. 

by construction. Moreover, for each j € {1, 2}, we have that 

—A(k®) >AKD —af(-.,cP)KD in 25/2, ; 
if and only if 

Kka[—A, 925, |]@5,; 2AKGs,; — af, KOs, j)KGs,; in 25/2, ; 
or equivalently, 

af (+, «Gs,j)) 24—o[-A, 25,;] in 25/2, ; 
which holds true for every x > 0 since, due to (5.6), 

af(., Ks, j) 20>A—o[-A, 25,;] in 25, ;. 
Further, we have that 

—A(k®) > AK —af(,kP)k® in 2 \ (Qsy2,1 VU B5/2,2) 
if and only if 


—Ag- . = _ 
—— >h-af(,«g_) in 2 \ (25/2,1 U 25/2.) 


which holds true for all sufficiently large « > 1, by (Ag), since a and g_ are positive and 


bounded away from zero in 


2 \ (25/2,1 U 2572.2) CC Q-. 


Therefore, (5.8) provides us with a supersolution of (5.3) for sufficiently large « > 1. Con- 
sequently, by Theorem 3.5, (5.3) possesses a positive solution if and only if condition (5.5) 
is satisfied. Moreover, it is strongly positive and unique. Subsequently, the unique positive 


solution of (5.3) will be denoted by 


0(A) = O,.2] = Fa,2,0]- 
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Now, the proof of Proposition 4.3 can be easily adapted to prove (2.6) and to show that the 
map (2.8) in point-wise increasing. Actually, 


O.,2] <K Ou,2] ifog <A <pU<0O}1, 
which can be derived from Lemma 3.6. So, the technical details of the proofs of these 
features, by repetitive, will be omitted here in. 


Now, we will prove the following property 


ne 61,2] = Co uniformly in compact subsets of (29,1. (5.9) 
1 


Pick 41 € (00, 01) and consider 7 > 0 such that 


O12] > NGo1 in Qo.1, (5.10) 


where ¢o,1 >> 0 is a principal eigenfunction associated with o; = o[—A, 29,1]. By dif- 
ferentiating the realization of (5.3) at 6(A) with respect to A, particularizing the result at 
0(A) = OQ], and rearranging terms gives 

(-A+ atl (., 0(A))0(A) + af (-,A(A)) — a) #a) =6O(A) in, 


a (5.11) 
aA) = 9 ond. 


It should be noted that (5.11) follows straight ahead from the proof of the differentiability 
of the mapping A +> 0@(A) := O1,,,.q] through the adaptation of the proof of Proposition 4.3. 
Since 


a“(, 0(A))O(A) >0 in 
and 


A=o[-A +af(-,0()), 2], 


we find, from the monotonicity of the principal eigenvalue with respect to the potential, 
that 


Ou 
> o[-A+af(-,0(a)) —a, 2] =0 


a[-a + Pale 0(A))O(A) taf (-,A(A)) —A, a| 


and therefore, thanks to Theorem 3.1, the differential operator 


—A+ aH, O(A))O(A) taf (-,A(A)) — 
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satisfies the strong maximum principle in 2 under Dirichlet boundary conditions. In par- 
ticular, it follows from (5.11) that a (A) > 0 and, consequently, A +> @(A) is strongly 
increasing. Now, due to (5.10), for each A € [A;, 01), we have that 

2,2) > NP0,1 in 2,1, 


and hence, (5.11) gives 


(—A —A) $A) > ngo1 in Roa, 


Y (5.12) 
7A) > 0 on 09291 
since SAI > 0. Moreover, for each A € [A1, 01), 
o[—-A—-A, Moi] =o, -—A>0 
and therefore, thanks again to Theorem 3.1, we find from (5.12) that 
dé ; 
ag > in 21, (5.13) 


where YW, is the unique solution of 


(-A-—A)%=n¢go1 in 201, 
Ww =0 on 0£20,1. 


A direct calculation shows that 


= 


i 0,1 
op-Al” 


and hence, (5.13) gives 


dé 
lim —(A)=oo uniformly in compact subsets of 20,1. 
Ato dx , 


Consequently, (5.9) holds true. 
Before ending the proof of Theorem 2.3, we shall begin the proof of Theorem 2.2. Sub- 
sequently, for each M > 0, we consider the following nonlinear boundary value problem 


—Au=hu-—af(.,uju in D, 
(5.14) 
u=M on 0D, 
where 
D:=2\ 291; =2-UR2. (5.15) 


The notation (5.15) will be maintain in the remaining of this section. The following result 
is satisfied. 
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LEMMA 5.1. Problem (5.14) possesses a positive solution if and only if X < 02. Moreover, 
it is unique if it exists and if we denote it by ),p,m, then 


0K On,,D,M1] K a2,D,Mo] in D 


—0 <h1 <h2 <0, 0<M, < Mp, dg — 20, + Mr —M, > 0. 


Also, for any . < 02 and any positive strong subsolution (resp. supersolution) u (resp. u) 
of (5.14), one has that u < 0), p,m] (resp. U > ,,D,m))- 
Furthermore, for each M > 0, 4 < 02 and uo > 0, 


lim u[,,p,m)C, ts 40) =p,,D,m]_ in C(D), 
ttoo 


where u[,,D,M\(X, t; uo) stands for the unique solution of the parabolic problem 


& _ Au=du—af(-,u)u in D x (0, 00), 
u=M on 0D x (0,00), (5.16) 
u(-,0) =u9 in D. 


PROOF. For any sufficiently small 6 > 0, consider the 5-neighborhood of I 

I1,5:= 1) + Bs(0) = {x € Q: dist(x, M1) < 4} (5.17) 
and the open subdomain of {2 defined by 

215:= DUT 15; (5.18) 
5 > 0 must be chosen sufficiently small so that 

0821.5 C 20,1 and o[—A,I\.5] > 02 =a[-A, 202]. (5.19) 


The second relation of (5.19) can be got since the Lebesgue measure of I, ,5 decays to zero 
as 6 | 0, by Faber—Krahn inequality (cf. [43], if necessary). 

Suppose u > 0 is a solution of (5.14). Then, thanks to Lemma 3.4, u >> 0. Moreover, 
since u is a positive strict supersolution of —A — 47+ af(-,u) in D under homogeneous 
Dirichlet boundary conditions, it follows from Theorem 3.1 that 


0 <o[-A—A+af(-,u), D] <o[—A-A+af(-,u), 20,2] =o2 -—A 
by the monotonicity of the principal eigenvalue with respect to the domain. Note that a = 0 
in (29,2. Thus, 4 < 02 is necessary for the existence of a positive solution of (5.14). Con- 


sequently, in the remaining of the proof we suppose 


Xx <0?. 
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Thanks to Theorem 3.5 and Lemma 3.6, in order to complete the proof of Lemma 5.1 it 
suffices to construct a positive supersolution for (5.14). 
Let 9,5 > 0 be a principal eigenfunction associated with o[—A, I},5]. Note that, due 

to (5.19), 

X <02 <o[—A,I\,5]. (5.20) 
Now, reduce 6 > 0, if necessary, so that the 5-neighborhood of 20,2 defined by 

25,2 = 20,2 + Bs(0) = {x € 92: dist(x, 29,2) < 5} 
satisfy 

X <o[—A, 23,2] < 02, (5.21) 
and pick a principal eigenfunction associated with o[—A, 25.2], say @5,2 >> 0. Fix a suf- 
ficiently small 6 > 0 satisfying the previous requirements and consider the function W 


defined by 


gis in 21,5\ {xe D: dist(x, PF) > 5}, 
Wi=} 95.2 in Qs », (5.22) 
gy in{x€Q_: dist(x,d2_) > $}, 


where g_ is any positive smooth extension, bounded away from zero, of ¢1,5 V 3,2 to 
; é 
Q_31= 4x € Q_: dist(x, d2Q_) > af" 
We claim that the function 
U:=KW 


is a positive supersolution of (5.14) in D if « > 1 is sufficiently large. Indeed, by construc- 
tion, u >> 0, and «kW > M on I; = OD for sufficiently large « > | since 


min >0. 
i $1,6 
Moreover, in the set 
. é 
xEN_: dist(x, I) < 5 


we have that 


—-A(KW) SdAKkW —af(., KW)KV (5.23) 
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if and only if 

Ko[—-A, T1,5]91,5 2 AK G1,5 — af (-, KP1,5)KGL,S, 
or equivalently, 

af(-,K~1,5) 24 —o[-A, T1,5] 
which is true because, due to (5.20), 

af(-,«g1,3) 20>A—o[-A, 1,5]. 
Similarly, in 25/2,2, (5.23) is satisfied if and only if 

af (-,« 95,2) 24 — o[-A, 25,2], 
which holds true by (5.21). Finally, in 82_,5, (5.23) is satisfied if and only if 


Ag- 
af(:,Kg-) A+ pen 


which holds true for sufficiently large « > 1, since g_ and a are positive and bounded 
away from zero. Consequently, u = kW provides us with a positive supersolution of (5.14) 
for any sufficiently large « > 1, which ends the proof. 


Thanks to Lemma 5.1, the point-wise limit 


O[2,D,00] = eae O4,D,M] (5.24) 


is well defined in D for each 4 < o2. We claim that it is finite everywhere in D. Indeed, 
setting 


avy i= max{ M, max ,p.m1| +1, M>0, 
2 
we have that 
On,D,M\laga.<am, M>0, 
and hence, @,,p,mj|@_ provides us with a positive strong subsolution of 


eerie in 92_, (5.25) 


u=ay on 082_. 


Thus, thanks to Lemma 4.10 and Theorem 4.11, we have that, for each M > 0, 


01.,D,M] K 9,2_,ay] < Leos in Q_, 
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where Lit] stands for the minimal large solution of (1.9) in §2_. Therefore, passing to 
the limit as M + oo gives 


1, D,oo] & Lie] in 92_. (5.26) 


This shows that (5.24) is finite in (2_. To prove that it is finite in 20.2 we can use the 
following result. 


LEMMA 5.2. For each sufficiently large n € N, say n > no, let Dy, denote the open set 
defined in (4.35), where D is given by (5.15), and, for each M > 0, consider the boundary 
value problem 


| —Au=aAu—af(-,uju in Dn, (5.27) 


u=M on 0Dn. 


Then, (5.27) possesses a positive solution if and only if .. < 02. Moreover, it is unique if it 
exists and if we denote it by 01,.,p,,m), then, for each n > no, 


0X O1,D,.Mi] K Ofa2,D,,M>] in D 
provided 

—0 <hj < Ad. <0, 0<M, <M), A2 —A, + Mo — M, > 0. 
Moreover, for any X < 02 and any positive strict subsolution (resp. supersolution) 


u (resp. u) of (5.27) one has that u < ,,D,,M] (resp. U > O1.,D,,M])- 
Furthermore, for each M > 0, X < 02, and ug > 0, 


lim uja,p,,m)C, t; Yo) = O,D,,.M); 
ttoo 


where uj,,D,,M\(X,t; uo) stands for the unique solution of the parabolic problem 


 _ Au=du—af(-,u)u in Dy X (0,00), 
u=M on 0Dy X (0, 00), 
u(-,0) =uo in Dy. 


The proof of Lemma 5.2 is easier than the proof of Lemma 5.1 since a is positive and 
bounded away from zero on 0D,, which simplifies the construction of the basic superso- 
lution pattern W. Therefore, its technical details are omitted here in by repetitive. 

Now, fix n > no. As 0D, is acompact subset of (2_, due to (5.26), there exists a constant 
C(n) > 0 such that, for each M > 0, 


Oa,D,.M)<C(n) on dDy. 
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Thus, thanks to Lemma 5.2, for each M > 0 we find that 
O1a,.D,.M] <Fa,Dy.cm)] 11 Dp 
and, consequently, 1, D,0o] 18 finite in D,. As this argument is valid for each n > no and 
(oe) 
D= lJ Dn. (5.28) 
n=no 


necessarily /) poo] 18 finite in D. 
The previous argument can be easily adapted to show that, for any n > no, each of the 
point-wise limits 


O12. Dn,co] *= es O12.,Dn.M] (5.29) 


is well defined and finite in D,. 
Now, adapting the argument of the final part of the proof of Proposition 4.7, it is easy to 
see that 01,,D,co] € C2+H(D) provides us with a positive solution of 


(5.30) 


ene in D, 
u=o on 0D. 


Actually, it is the minimal positive solution. Indeed, let L be any positive solution of (5.30). 
Then, for each M > 0, there exist a constant C > 0 and a sufficiently large n € N such that 

On,.D.M)<C<L in D\ Dy. (5.31) 
Moreover, thanks to Lemma 5.2, (5.31) implies 

[2,D,M] <Fa,D,,c)<L in Dn, 
and consequently, 

O,D,M)<L in D. (5.32) 
Therefore, passing to the limit as M 4 00 in (5.32) we find that 

91n,D,0o] < L, 


which shows its minimality. Consequently, the solution 6[,,p,00o) provides us with the large 
solution Li. DI referred to in the statement of Theorem 2.2. 
Similarly, for each n > no, the point-wise limit (5.29) provides us with the minimal 


positive solution of 


a =Au—af(-,uju in Dy, 


(5.33) 
u=oo on 0Dn, 
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which will be subsequently denoted by Le 
We now show that the point-wise limit 


Lip] = He Lin. Dal (5.34) 


is well defined and that, actually, it provides us with the maximal solution of (5.30). Indeed, 
for each M > 0, n > no and m > 1, we have that 


OA, Drm. MI SOA, Drm.) <A,Dy,00] In Dn. (5.35) 


Thus, due to (5.28), for each compact subset K C D, there exist C(K) > 0 and nx EN 
such that, foreach M > 0 andn >nx, 


O1.,D,,.M)<C(K) ink, 
and hence, 
La) <C(K) ink. (5.36) 


From these a priori estimates, a diagonal argument combined with the compactness of 
(—A)~!, shows that (5.34) is finite in D and that it provides us with a solution of (5.30). 
To show the maximality of Lin py let L be any positive solution of (5.30). Then, for each 
n > no, there exists M > 0 such that L|p,, provides us with a positive subsolution of (5.27), 


and therefore, thanks to Lemma 5.2, 

L <62,D,,M] <9 A,Dp,co] =n Dn. 
Consequently, passing to the limit as n + 00 gives 

L< Lip): 
To conclude the proof of the existence of Theorem 2.2 it remains to shows that 4 < 02 is 
necessary for the existence of a positive solution of (5.30). Suppose L is a solution of (5.30) 
for some A € R. Then, for each n > no, L|p, provides us with a positive strict supersolution 
of —A+af(-, L)—A in D, under homogeneous Dirichlet boundary conditions, and hence, 
thanks to Theorem 3.1, 

o[-A +af(.,L)—-4, Dn| > 0. 
Therefore, by the monotonicity of the principal eigenvalue with respect to the domain 


4 <o[-A +af(.,L), Dn] <o[—A +af(-, L), 20,2] =02 


since a = 0 in 29,2. Note that, in order to complete the proof of Theorem 2.2, it remains 
to show (2.5). 
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Now, we shall show that 

es Lay =oo uniformly in compact subsets of 20,2. (5.37) 
To prove (5.37) we need the following result. 


LEMMA 5.3. Consider the problem 


—Au=hu-—af(.,uju in D, 
(5.38) 
u=0 on 0D, 
where D= 22 \ 20,1. Then, (5.38) possesses a positive solution if and only if 
o[—A, D] <A <0. (5.39) 
Moreover, it is unique if it exists and if we denote it by 6, p), then the mapping 
(o[-A, D], 02) > (2), 
(5.40) 
AR O(A) = On, D] 
is point-wise increasing and of class C'. Furthermore, 
ie 61.,D] =0O uniformly in compact subsets of S20,2. (5.41) 
02 


PROOF. Suppose u > 0 is a solution of (5.38). Then, by Lemma 3.4, u >> 0 and 
A=oa[-A+af(,u), Di}. 

Thus, 
o[—-A, D] <A= o[-A +af(-,u), D| <o[—A, 20.2] =02 


since a = 0 in 929.2. Therefore, (5.39) is necessary for the existence of a positive solution. 
Suppose (5.39). Then, thanks to Lemma 5.1, the problem 


| —Au=hu-af(.,uju inD, 
u=l1 on dD 


possesses a unique positive solution, 6,,p,1). Clearly, u := ,,p,1] is a positive supersolu- 
tion of (5.38) and consequently, the lemma is a direct consequence from Theorem 3.5 and 
Lemma 3.6, except for the regularity of the map defined in (5.40) and (5.41), which can be 
easily obtained by adapting the argument used to prove the regularity of the map (2.8) 
and the proof of (5.9), respectively. By repetitive, we shall omit the technical details 
here in. 
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Now, we are ready to prove (5.37). Thanks to Lemma 5.1, foreach M > Oand A, we R, 
X. < [Lh < 02, we have that 


9.,D,M) < u,D.M] 
and hence, passing to the limit as M 4 00 gives 
min min 
Pin,Dl S Pty, Dy- 


Thus, the point-wise limit 


Le3= ye Li] (5.42) 


is well defined in D. Moreover, for each M > 0, we have that 
Lip) > 00..D,M] > 9p, D1, 


and therefore, (5.37) follows from (5.41). 

Subsequently, we shall complete the proof of (2.7), which concludes the proof of The- 
orem 2.3. For a fixed n > no we will consider the open set D, defined in (4.35) with 
D=2\ 20, 1. For each M > 0, let @o,,p,,1) be the unique positive solution of (5.27) at 
A. = 0. Such solution exists by Lemma 5.2. For each A € (00, 01), set 


M), := max 9),,9].- 
aDn 
Then 61,,,21/ap, <M, and, thanks to Lemma 5.2, we find that 


2,2) < For,Dn,M,] 10 Dn. 


Thus, 


OA,2] < List Dy] in D, (5.43) 


[o 
since 


min _ 4: 
Lot. Dn] = ries Ofo1,Dn.M1- 


As the mapping A +> ,,,@] 1s increasing and (5.43) holds for each A € (op, 01) andn > ng, 
it is apparent that the point-wise limit 


Lo, := lim 6.9) in D (5.44) 
tor 
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is well defined and finite. Actually, Lo, € C2+#(D) provides us with a solution of (1.9) 
in D. In order to prove the identity 


_— ymin 
Lo = Lig,,)° 
it suffices to show that 


lim min 6,2] = co (5.45) 
Ato, aD 


(note that 0D = I). Indeed, suppose (5.45) has been proven. Then, setting 
m= min Opa], 4 € (90, 01), 
it follows from Lemma 5.1 that 
4,2] 2 9,D,m,] in D. 
In particular, for each ¢ > 0 and A € (oj — €, 01), 
01.2] S %o,-2,D,m,] in D. 
Thus, passing to the limit as A + 01, (5.44) implies 
Lge lie ep aD 


for each ¢ > 0. This shows that L,, provides us with a large solution of (1.9) in D. Simi- 
larly, we have that 


O[a,2] < Ha, D,maxyp Oy,011 S La" py in D 
and therefore, 

Lo, < Lp) in D. 
Consequently, 

Leese pie aD: 


and the proof of Theorem 2.3 will be completed if we show (5.45). Note that 
(5.9) and (5.45) imply 


lim 6,,2]=00 in 29,1 \ a2. 
Ato 


Thus, 1/0,,,,.], 4 € (00, 01), provides us with a decreasing family of continuous functions 
point-wise converging to zero in (29,1 \ 0S2, and therefore, it approximates zero uniformly 
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in compact subsets of 29,1 \ 082. Consequently, 6,,@] approximates oo as A f oj uni- 
formly in compact subsets of 29,1 \ 092. 

To prove (5.45) we argue by contradiction. Suppose (5.45) is not satisfied. Then 


b:= min Lo, € (0, 00). (5.46) 


ID=1, =020,1 \ 022 
is of class C2, there exist R > O anda map Y:dD— {29,1 such that, foreach x € dD= 1}, 
Br(¥(x))CQo1,  — Br(¥@))NIQ=G, ——_BrR(Y(x)) NID = {x}. 
Moreover, thanks to (5.46), for each A € (0, 01), there exists x, € 0D such that 
Oa,.2)%a) = aH Oa,2] < min Lo, =b. 
By construction, 
dist(x,., Y(x)) =R_  foreachd € (09, 01). 
Moreover, the manifold re defined by 
Df = {y € Qo1: dist(y, 8D) =2R} 
is a compact subset of (29,1, and hence, thanks to (5.9), 


lim 64,9) =00 uniformly in 7%. (5.47) 
Ato, : 


Setting 
25, = {y € Qo.1: dist(y, AD) < 2R}, 


it turns out that [7 ie is one of the components of 025 , while the other one consists of 0D. 
Let x, € 2s, be such that 


O,.2)(%.) = min O,,.2] 
2b 


and suppose x, € oe ,- Then 


VOn,21(%.) = 0, AO, 21%) = 9, 
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and, since 

(-A-A)O,,.2)=0 in 2G, 
we find that 

—Ada,.a1%a) = 2Op.,.2)(%,) > 0 


for each A € (09, 01) because A > 0, which is contradictory. Consequently, for each A € 
(00,01), 


% € 32h, =Nurf. 
Therefore, thanks to (5.47), there exists 6) € (09, 01) such that 


min 01,2] = min O21 = 9, 21%) <b 
0,1 


for each 4 € (61, 01). In particular, 
A, 21(X) > Oa,.a\(x,) foreach x € Br(Y(x)). (5.48) 
Now, for each a > 0 and A € (G1, 01), we consider the auxiliary function yy, defined by 
W(x) = en te-Yea? _ e-@R? tor each x € Br(Y¥(x)). 
A direct calculation shows that, for each x € Br(Y(x,)), 
(—A = A)Wa (x) = (24N — 40?|x — ¥ (x) |? — A)emTAP LOW? 4 em @R?” 
and hence, there exist a > 0 and w > 0 such that, for each 4 € (61, 01), 
(—A-A)~n <—@ in Ag := Br(¥ (a) \ Brpo(¥ Qa). (5.49) 


Subsequently, we will assume that w has been chosen to satisfy (5.49). Since Br /2(¥ (x,)) 
is a compact subset of (29,1, it follows from (5.9) that 


lim min 62,9] =00 
ATO1 Brjo(¥ (x,)) 


and hence, setting 


_ MNF a 19 (¥ (x) AA.21 — Ofa,21%A) 
ae e—aR2/4 _ g—aR? 
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we have that 


lim c, = co (5.50) 
Ato 


since 
ee Ofa,21(%) = B. 
By the definition of c,, for each A € (6), 01), we have that 
Oa,.a1X) S Oa,a (xr) +n (eos - eR") Vx € Brjo(¥ (x)). (5.51) 
Now, for each A € (6), 01), we consider the auxiliary function 
V, = On,.2] — 9,210) —CxWn in Ar = Br(¥(a)) \ Brjo(¥ (xa))- 
Thanks to (5.51), 
v, 20 on dBR/2(¥(x)). 
Moreover, since y% = 0 on dBr(Y (x,)), it follows from (5.48) that 
v, = O,2) — Or.) [0 on ABR(Y (x). 
Furthermore, due to (5.49), in Ar we have that 
(-—A —A)v, =AOp,2101.) — A (-—A — A), SAO, 210) + LO 
and hence, by (5.50), 
(-A-A)y,>0 inAr=Br(¥(x)) \ Br(¥)) 
provided 4 < 0; is sufficiently close to o;. Therefore, since 
A <0, =o[—A, 29,1] < o[—A, Ar], 
it follows from Theorem 3.1 that 
v(x) >0 if 5 <|x—Y(x)| <R, 
and consequently, 


A, 21%) = On,.21(42.) ForWr(x) foreach x € Ap. (5.52) 
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Now, setting 


_ ¥Q@a)— ma 
ny = ————_., 
R 
we have that 
00 6 t —0 
TA, 2] Bank [a,2] (Xa, + ty) [a,21)_ 
On), to t 


Moreover, thanks to (5.52), for each ¢ € (0, 8), we find that 


Oa, (%a + tna) — O,.a](x) 
t 
> CAWr (x), + ty) 
t 


cy (ene ha tim YO)? = ea’) 


t 


©, (enema Roa? _ ee?) 


t 


©, (ee R10? _ ee?) 


’ 


t 
and hence, since 


2 2 
; e 7 a(R-1) _ eR 2 
lim ; =2aRe~** 
110 


we obtain that 


0O[A,2] 
Nh 


(xa) = QaRe~?*’ cy. 


Therefore, thanks to (5.50), 


a0 
lim 2-2! 
Ato On), 


(x,) = 00. 
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(5.53) 


Subsequently, for each A < 01, A ~ 01, we consider the auxiliary boundary value problem 


—Au=hu-af(.,uju inD, 
u =O, Q\(%a) on oD. 


(5.54) 
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Since A. < 02, thanks to Lemma 5.1, (5.54) possesses a unique positive solution, denoted by 
D4 = OA,D.63,.e\0)- 

Moreover, since ,,,2]|p provides us with a positive supersolution of (5.54), we have that 
9, <O,9) in D. 


Therefore, since 0) (x,) = 6,,.21(%.), we find that 


oY (x,) 2 ga3:2 
On), On 


(x), 
and consequently, by (5.53), 


a0 
lim —*(4,) = 00. (5.55) 
Ato ony 


This is impossible, since the functions % approximate in C!(D), as A t 01, the unique 
positive solution, 0, := Oo,,D,p], Of 


ea in D, 
u=b on 0D. 


Therefore, (5.45) get shown, which completes the proof of Theorem 2.3. 
Finally, we will complete the proof of Theorem 2.2. It remains to prove (2.5). Thanks 
to (5.37), it suffices to prove that 


lim min L™",, = 00, 5.56 
Ato2 92,2 BPI ( ) 


where D = (2 \ 20.1, and that, for some large solution L of (1.9) in 2_, 


a min _ . 
is Lind] =L in. (5.57) 


We already know that, for each A < 02, 
La) > On, D)- 
Moreover, the proof of (5.45) can be easily adapted to show that 


lim min 6;,,p] = 09; 
Ato2 0920.2 


now, one must work with 0£20,1, instead of 0 D, though the technical details can be adapted 
mutatis mutandis. Therefore (5.56) holds true. 
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In order to prove (5.57), we consider the point-wise limit (5.42), which is well defined 
and equals oo in (29,2, and, for sufficiently large n € N, the open sets 


2” = {x € Q_: dist(x, 92_) > n7"}. 


Subsequently, for each 4 < 02, we set 


is min 
M,:= Ws Lin. py: 


By definition, Layla ar <My,. Hence, thanks to Lemma 4.10, 


LED] S 2,2", Mal S oo,2%,My1 S Lig ony in 2". 
Therefore, due to Theorem 4.11, we obtain that, for each A < 02, 


min Ra L™ 


KD] < Lio a) in. (5.58) 


[o: 
Consequently, the point-wise limit (5.42) is finite in (2. Moreover, by the monotonicity 
in A and the compactness of Cay it provides us with a large solution of (1.9) in 92_, 
which concludes the proof of Theorem 2.2. 
6. Proof of Theorem 2.4 
Part (a) is a direct consequence from the last assertion of Theorem 3.5, as well as part (b) 
since, due to Theorem 2.3, (1.1) possesses a positive steady state for each A € (00, 01). So, 
it remains to prove parts (c) and (d). Suppose 

01 <A <0. 
Thanks to the parabolic maximum principle, for each ¢ > 0 and t > 0, 

Upp, Q1C, t3 UO) S Ufo, —e,Q1(, t3 UO) 
since 4 > 0; — €, and hence, thanks to part (b), 


lim inf uy], 5 uo) > lim ujo,—¢,a]¢, t5 Uo) = Ao, —c,.2]- (6.1) 
ttoo ttoo 


As (6.1) holds true for each sufficiently small ¢ > 0, it follows from Theorem 2.3 that 


Bice 15 . : 2 min 
Tim inf wpy.<21( ,t; uo) > lim Oo —2,2) = Mi o.2\ 011" (6.2) 
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In particular, 
lim infup,aiC, t; uo) =o 
uniformly in compact subsets of 20, 1\02, 
and hence, for each M > 0 there exists a constant Tj > 0 such that 
up, Q(x, t;u0) = M_ foreach (x,t) € I x [Tu, 0). 
Thus, u1),,.@](, ¢; Uo) provides us with a supersolution of the parabolic problem 


4 _ Au=)u—af(-,uwju in (2 \ 20,1) x (Tu, 0), 
u=M on I x (Ty, 00), 
u(-, Tu) =upa,a\¢,Tusuo) in @ \ 20,1. 


By the parabolic maximum principle, we have that 
UlA,Q\(Xt; UO) 2 UTA, 2\%,1,M] (x, t—Ty3 up,a\C¢, Tu; uo) 


for each (x,t) € 2 \ 201 x (Ty, co). So, thanks to Lemma 5.1, 


Tim inf upa,ay@, t;uo) > ae UA,.2\2y1,My(%> t—Ty3 up,a\C, Tu; uo)) 


= 901,.2\2o.1.MI- 
Therefore, passing to the limit as M 4 00, 


hod ; Ss pmin : = 
Tim infu. 2y@, t; uo) > Li, 2\2o1] in 2 \ 201 


since 


min a F = 
[2,22\ 2.1) ~ HM 9.9\9 0,1.) 


(6.3) 


(see the proof of Theorem 2.2). Consequently, bringing together this estimate with (6.3) 


we find that 


. ° ‘, > min - . ; 
lim int upa,.21@, t; uo) > Me \Fo.] in §2 


(6.4) 


This estimate provides us with Theorem 2.4(c)(i) and the lower estimate of Theo- 


rem 2.4(c)(1i). 


Now, we assume, in addition, that ug is a subsolution of (1.9) in 92. Then, for each t > 0, 


the function 


Xr up,ay%,tyuo), xe€ 2, 
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is a subsolution of (1.9) in £2, since t > up, ,.Q](, f; uo) is increasing. Fix t > 0 and set 


M, := max Up, 2} 15 uo), D:=Q2\ 24. 


Thanks to Lemma 5.1, for each M > M,, we have that 
Ula, Q\C>t5 U0) S Ay 2\%4,my In 2 \ Qo. 
Hence, by the construction of the minimal large solution, 
. : a _ ymin : °. 
up,a}Cs t;uo) < ee 91.,.2\.1.M1 = Li, 2\2o.1] in 2 \ 20,1, 
and therefore, passing to the limit as t t 00, 


limsupupa,y(- #5 to) SS a ae in 2 \ 2o,1. 


Consequently, due to (6.4), 


¢ e min s 
ie ua, ayC, t; Uo) = WM [..2\Fo1] 2 Q, (6.5) 


which concludes the proof of Theorem 2.4(c)(iii). 
Now, suppose uo is arbitrary — not necessarily a subsolution of (1.9) in 92 — and 


A202. 

Then, thanks to the parabolic maximum principle, we have that 
Upp, Q1C, t3 UO) S Ufon—2,Q](¢, 5 U0) in LQ, 

and hence, it follows from (6.4) that 


cote fr,a]C, t3 Uo) = eM on—€, QC, f5 Uo) > ee oes (6.6) 


in 2 for each sufficiently small ¢ > O since 

0, <02—€<0). 
Note that we cannot apply (6.5) since ug might not be a subsolution of (1.9) in 2. As 
(6.6) is satisfied for every sufficiently small ¢ > 0, and, thanks to Theorem 2.2, there exists 


a metasolution of 


—Au =o02u —af(.,u)u 
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supported in Q_, say IN{o,,Q_], Such that 


limgm" 
elo [o2-€, 


Q\2o1] — Mjor,2_1: 
it follows from (6.6) that 


lim inf upa,ay(, t; uo) > Mior,@_] nL. 
ttoo 


In particular, 


liminfup,a\(. ti uo) =0o in Q\ Q- (6.7) 
ttoo 


which concludes the proof of Theorem 2.4(d)(i). Moreover, since (6.7) occurs uniformly 
on 0§2_, for each M > 0, there exists a time Ty > O for which 


upr,,ay(x,t;u0) > M_ if (x,t) €0Q_ x (Ty, ow). 
Thus, 1,2], t; uo) provides us with a supersolution of the parabolic problem 


 — Au=Au—auf(-,u) in 2_ x (Ty, 00), 
u=M on 092_ x (Tu, 00), 


u(-, Tm) =up,ai¢, Tus uo) in 82_. 
By the parabolic maximum principle, we have that, for each (x, f) € Q_ x (Ty, ov), 
Ur,Q\(X,t3 Uo) > Upa,e_,my(x.t — Tus upy,ayC, Tu; uo)), 
and hence, thanks to Theorem 4.9, 
lim inf uj, a}, t;uo) > lim UlA,2Q_,M] (x, t—Ty; ur, QlC, Tu; u0)) 
ttoo ttoo 
= 01.,2_,M]- 
Therefore, passing to the limit as M ¢ 00 gives 
liminfup,e)(, ti uo) > Lit) in Q- 
ttoo 


since 


min : 
= lim 6 : 
[A,2_] Wie [A,2_,M] 


Consequently, bringing together this estimate with (6.7) gives 


liminfup.aC.t: uo) > Mi", in (6.8) 
ttoo a8 
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which provides us with the lower estimate of Theorem 2.4(d)(ii). 

Now, besides A > 02, suppose ug is a subsolution of (1.9) in §2. Then, for each t > 0, 
the function u[,,.Q](,¢; uo) is a subsolution of (1.9) in 92, since f +> up a](-, ts uo) is 
increasing. Fix t > 0 and set 


M, := mee upa,ayC, t; Uo). 


Thanks to Lemma 4.10, for each M > M,;, we have that 
up,ay¢.t; Uo) < Op,e_,m) In 2_, 


and hence, 


Uup,ay(.ti uo) < lim 6n,29 m= Lia] in 22_. 
M*tco : 


Therefore, passing to the limit as ¢ t 00, 


lim sup up,,.a1¢, t3 uo) < ry in 2Q_ 
ttoo 


and, consequently, due to (6.7) and (6.8), 


lim upa.a\¢,t; uo) = Mi") in 2, 
ttoo 


which concludes the proof of Theorem 2.4(d)(iii). 

To conclude the proof of Theorem 2.4, it remains to obtain the upper estimates for an 
arbitrary uo > O, in order to get the upper estimates of parts (c)(ii) and (d)(ii). To do this, 
the strategy adopted here consists in obtaining a priori bounds in §2_ for the solutions 
of (1.1). These a priori bounds can be obtained as follows. 

Fix 4 > oj and consider the function uj, .Q(, 1; uo) >> 0. Then, there exists « > 1 such 
that 


ur, aC, 1; uo) < Kg, (6.9) 
where ¢ > 0 is a principal eigenfunction associated with o9. We claim that there exists 

A > max{A, 02} (6.10) 
for which the function «¢g is a subsolution of 


cao in 2, (6.11) 


u=0 on dg. 


Indeed, since xg = 0 on 022, kg is a subsolution of (6.11) if and only if 


—A(kg) < Akg—afl,Kp)ke in, 
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or equivalently, 
af(,Kg)<A-—oo in 
which is satisfied for any sufficiently large A satisfying (6.10). 
Now, thanks to the parabolic maximum principle, it follows from (6.9) that, for any 
(x,t) € 2 x (0, 0), 
upr,a(x,t + 1; uo) = upr,ay (x. ts upayG 1; uo) Supa 6 Kg). 
Similarly, (6.10) implies 
Up, ayC. ts KY) < Up, QC, Ft; KQ). 
Thus, for each t > 0, 
upn,al(,t+1;u0) <upy-Qqi(.ti Ke) mQ. (6.12) 
As k@ is a subsolution of (6.11), it follows from part (d)(iii) that 
lim wra,ai. 6 €9) = Lite) m2, 
and hence, (6.12) implies 


lim sup up,,.@1(, t3 uo) < Lio } in. (6.13) 
ttoo 


Consequently, uj,,@)(-, f; uo) 1s uniformly bounded above in any compact subset of S2_ 
for each t > 0, which provides us with the necessary a priori bounds to complete the proof 
of the theorem. 

Subsequently, we suppose 


01 <A <0, 


and for each sufficiently large n € N, we consider the open set 
=: ; 1 
Dy i= 4x € D:= 2 \ 20,1: dist(x, AD) > — +. 
n 


Fix one of these values of n. Since 0D, C §2_, it follows from (6.13) that there exists a 
constant Mo > 0 such that, for each M > Mo and t > 0, 


up,ayC.tiuo) <M ondDp, 
and hence, the parabolic maximum principle shows that, for each t > 0, 


ury,ay(, ts Uo) <up,d,,M]C>t; Uo) im Dn, 
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where u,,p,,M](. ¢; uo) is the solution defined in Lemma 5.2. Due to Lemma 5.2, we have 
that 


lim uja,D,,M1C, t3 Uo) = O,D,,M] in Dn 
ttoo 


and therefore, 


lim sup up,,a](, t5 uo) < Aa,pD,,M] in Dn. (6.14) 
ttoo 


Consequently, passing to the limit as M 4 oo in (6.14) gives 


lim sup up,,.a(, 0; 40) <LI") in Dn. (6.15) 


ttoo 


As (6.15) is valid for all sufficiently large n € N, and, thanks to the analysis carried out in 
the proof of Theorem 2.2, we already know that 


Lip = lim Lino, 
we find from (6.15) that 


ESPEN: thug) < Lin. Dl in D, 
ttoo 


which concludes the proof of part (c)(ii). 
Finally, suppose 


A202, 


and, for each sufficiently large n € N, consider the open subset of 2_ defined by 
. 1 
Q" :=})x€Q_: dist(x,IQ_) > — 
n 


and fix one of these values of n. Since 02” C Q_, it follows from (6.13) that there exists 
a constant Mo > 0 such that, foreach M > Mo and t > 0, 


upr,alCstsuo) <M onda". 
Thus, by the parabolic maximum principle, we have that, for each t > 0, 


upr,alCs ts uo) upon my. tiuo) in 2", 
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where Uj,” mj (-, t; Uo) is the unique solution of the parabolic problem 


—Au=hu-—af(-,u)u in 2" x (0, 00), 


u=M on 082” x (0,00), 
u(-,0) =uo in Q”. 
Thanks to Theorem 4.9, 


lim up.en myiCs ts Uo) =%,07,m) in Q" 
ttoo 
and therefore, 


lim sup up,,2](t3 40) <Pp.e2,.my in 2". (6.16) 
ttoo 


Consequently, passing to the limit as M ¢ oo in (6.16) gives 


lim sup u,,,.2](, t3 uo) < Lia in Q". (6.17) 
ttoo 


As (6.17) is valid for all sufficiently large n € N and we already know that 


D2 a lim Lion 


(6.17) implies 


ee ta,a1(, ts; uo) < Lia, } ing@_ 
lee) 


which concludes the proof of part (d)(ii). The proof of the theorem is completed. 


7. Proofs of Theorems 2.6—2.8 


The proofs of Theorems 2.6 and 2.7 are based upon the following estimates for the bound- 
ary growth rate of the large positive solutions of 


—Au = hu — au? (7.1) 
in D € {2 \ 20, Q_}. 


PROPOSITION 7.1. Under the assumptions of Theorem 2.6, for each i. < 02 and any large 
positive solution L(x) of (7.1) in Q \ 829,1, one has that 


lim L(x; — tmy,) 
110 B(x) [dist(x] —tm,,, 11)]7 a (x1) 


=1 foreachx,;€el\, (7.2) 
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where n,, stands for the outward unit normal to 82 \ 2031 at x, and 
2 
yx) + (73) 


e(x1)(@ (x1) + ae 
EEE ; 


: B = 
a B(x1) 


a(x,) = 
Therefore, for any pair (L1, L2) of large positive solutions of (7.1) in 2 \ Qo,1, one has 
that 


. Ly (x1 — my, ) 
lim —————— = 1 foreach x, € I). (7.4) 
110 Lo(x1 — tny,) 

Notice that, for each x; € I, and sufficiently small ¢ > 0, 
dist(x; —my,,, 1) =¢. 


PROPOSITION 7.2. Under the assumptions of Theorem 2.7, for each i € R and any large 
positive solution L(x) of (7.1) in 82_, one has that 


litt L(x; — ty,) 
1/0 B(x) [dist(x — My, , 02_)|-*e) 


=1 foreachx, €092_, (7.5) 


where nx, stands for the outward unit normal to 82— at x, and a(x,) and B(x}) are given 
through (7.3). Therefore, for any pair (L,, L2) of large positive solutions of (7.1) in 2_, 
one has that 


fig ES ts ee ace as. (7.6) 
110 Lo(x1 — ty, ) 

The distribution of this section is as follows. In Section 7.1 we show that in one spatial 
dimension the estimates (7.2) and (7.5) follow in a rather natural manner. In Section 7.2 
we characterize the boundary blow-up rates of the large solutions of (7.1) for some related 
radially symmetric problems. In Section 7.3, we prove Propositions 7.1 and 7.2. In Sec- 
tion 7.4 we complete the proofs of Theorems 2.6 and 2.7. Finally, in Section 7.5 we prove 
Theorem 2.8. 


7.1. Finding out the boundary blow-up rate of a large solution 


In one space dimension, N = 1, as well as in the radially symmetric case, the fact that (2.9) 

and (2.10) imply (7.2) follows in a very natural manner. Suppose that we want ascertaining 

the blow up rate at R > 0 of any solution u(x) of the one-dimensional singular boundary 
value problem 

—u"=)u—au? in(0,R), 

| (7.7) 


u(O) =0, lim, +R u(x) = 00, 


280 J. Lopez-Gomez 


where, for some y > 0, 
a(x) = B(x)(R—x)”, x €(O, R), B(R) £0. 
Then, the change of variable 
u(x) =(R—x) “y(x), x €[0, R], 
where a > 0) has to be determined, transforms (7.7) into the differential equation 


(R= x)? W(x) + 200(R — x) W(x) Fala t+ DR - x) (x) 
= B(x)(R — x)¥ PP (x) — A(R — x) W(x) (7.8) 


subject to the boundary conditions 
y (0) =0, W(R) € (, 00), 


so that w provides us with the exact blow-up rate of wu at R. Multiplication by (R — x)*+? 
transforms (7.8) into 


(R= x)? wh" (x) + 20(R — x) W(x) Fa(a + IY (x) 
= B(x)(R — x)¥ OP TOF P(x) — A(R — x) (x). 


Thus, assuming 

lim[(R — x)? v"(x)] = lim[(R — x)W'(x)] =0, 

Him [(R = )?W"()] = lim [(R = WC] 
one is driven to impose 

y-—ap+a+2=0, a(a + 1)W(R) = B(R)W?(R), 
which provides us with the values of a and w(R). Namely, 


a(a + a 


2 
a= wat and W(R) => bene 


1 


in complete agreement with the statement of Propositions 7.1 and 7.2. 
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7.2. Two auxiliary radially symmetric problems 
The main result of this section is the following lemma. 
LEMMA 7.3. Suppose xo € RY,R>0,AER, p>tl,y20and 
B(x) =f), r:=|x—xol, 8 €C([0, RI; (O, 00). 
Then, for each ¢ > 0, the singular boundary value problem 


—Au =au — B(x)[dist(x, 9Br(xo))]”u? in Br(xo), 
u=oo on 0Br(xo) 


possesses a positive solution Lz such that 


Sonic Le (x) : Le (x) 
1 —e < liminf ————_ < limsup ————_ <l+e, 
d(x)10 B[d(x)] d(x)jo Bld(x)] 
where 
d(x) := dist(x, ABr(xo)) = R — |x —x0|= R—-r 
and 
ey Zz Ea 
pol B(R) 


PROOF. Note that the radially symmetric solutions of (7.9) are given by 
u(x):= Wir), r= |x— xo, 
where 7 satisfies 


—y" — Sw =)rv- BU)(R-r)’? in (0, R), 
w'(0) => 0, lim,4R Wr) =O. 
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(7.9) 


(7.10) 


(7.11) 


(7.12) 


First, we show that, for each sufficiently small ¢ > 0, there exists a constant A, > 0 such 


that, for every A > Ag, the function 


2 
7 r 
wWe(r):= A+ B.(Z) (R-r)*, Be:=(1+e)B, 
provides us with a positive supersolution of (7.12). Indeed, 


w,(0)=0 and ae We(r) =00 


(7.13) 


282 J. Lopez-Gomez 


since a > 0. Thus, W- is a supersolution of (7.12) if and only if 


B B 
2N—(R—r)% aN +3) 25r(R ry 


r ea 2 
—a(a+ nB.(7) (R —-r) 


2 

>nR—n-*[ AR =n" + B,(7) 
r 2 P 
= piry(R=nyr-eF] AR =H) + By(Z) . 


Thus, multiplying this inequality by (R — r)“*+? and taking into account that 
a+2+y-—ap=0, 


we find that y, is a supersolution of (7.12) if and only if 


By 2 By r : 
2N—(R—-r) w(N +3) FER 1) —ate+ DBs(Z) 


2 27p 
SIRS P| ar rt 4 B.(7) = pon] AR rt 4 B.(7) 


(7.14) 
At r = R, (7.14) becomes into 
—a(a+1)By >—B(R)B?, 
which is satisfied if and only if 


= +1 
pe, 
B(R) 


Therefore, by making the choice (7.13), the inequality (7.14) is satisfied in a left neighbor- 
hood of r = R, say (R — 6, R], for some 6 = 5(€) > 0. Finally, by choosing a sufficiently 
large A, it is clear that the inequality is satisfied in the whole interval [0, R] since p > 1 
and £ is bounded away from zero. This concludes the proof of the claim above. 

Now, we will construct an appropriate subsolution for problem (7.12). For doing this 
we shall distinguish two different cases according to the sign of the parameter A. First, we 
assume 


> 
\WV 
oO 
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Then, for each sufficiently small ¢ > 0, there exists C < 0 for which the function 


2 

vO := max 0. C+B_ (=) (R= a 
provides us with a nonnegative subsolution of (7.12) if 

BL=(1—s)B. (7.15) 
Indeed, it is easy to see that y ; is a subsolution of (7.12) if in the region where 

2 
te 
C+ B-(=) (R-r)* 20, 


the following inequality is satisfied 


B_ —a B_ —a-—l1 
2N Re (R—r) a(N + aa —r) 
ya_(2.) Rn? 
—a(a+ 1) -(4) (R—-r) 


Zz 
< A(R =r) jor =r) + s-(z) 


r aR 
= piy(R—nyr-e#] (R=) + B-(Z) : 


Equivalently, 


R 


2 29P 
<nr—r?[coR- nt +8-(4) ]-em|cr-ne+2-(Z) 


(7.16) 


BL . BL ry? 
2NTS(R=1) uN +3) 35r(R 1) —ata+ DB-( 2) 


Now, note that for each C < 0 there exists a constant 
z=2(C) € (0, R) 


such that 


2 
C+B_ (=) (R-r)* <0 ifre[0,z(C)) 
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and 
7 2 
c+B(7) (R-r)*>0 ifr e[z(C), R) 


because the mapping 


r\? ans 
ro (5) (R—r) 


is increasing. Moreover, z(C) is decreasing with respect to C and 


li =R li =0. TAT 
ane ; lim 2(C) 0 (7.17) 


Thus, since 4 > 0, for each r € [z(C), R), the following condition implies (7.16) 


27? 2 
pen] cr -r)" + B( 5) <a(a+B_(4) (7.18) 


Note that, since C < 0, for (7.18) to be satisfied it suffices that 


oa ( r er 
Br) Be R <a(at+1) (7.19) 


for each r € [z(C), R). Making the choice (7.15) and using the continuity of B(r), it is easy 
to see that there exists a constant 6(€) > 0 for which (7.19) is oe in [R — d(e), R). 
Moreover, thanks to (7.17), there exists C < 0 such that z(C) = R — 6(e). For this choice 
of C, it readily follows that Vv, provides us with a subsolution of oa 12). 

Similarly, it is easy to see ‘that there exists C <0 for which the function 


2 
wv.) = eV AR) max 0, C+ B_ (+) (= sl 


provides us with a subsolution of (7.12) if A <0. 
Note that in each of these cases 


be(r) ¥ ©) 
lim —————— = 1, lim ——*——__. = 1, 
rtR Ba(R—-r)* rtR B_(R—1r) 


where Bs and B_ are the constants defined in (7.13) and (7.15). Moreover, for any suffi- 
ciently large A > Ag, 


an <e; 


—E 
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and hence, 


{sali UO ge We) 


= ae SS ——— =I +6. 
rt+R B(R—1r) rtR B(R—r) 


Therefore, setting 
Lw=¥.0), Le) :=Welr), r= |x—xol, 


Chg; 2) provides us with an ordered sub-supersolution pair of (7.9) such that 


L ie 
fe ies oe ey (7.20) 
d(x)}0 BIG)” d)10 BId@)] 


Consequently, by Theorem 3.3, there exists a positive solution L, of (7.9) such that 


Lge TiS Te, 


E 


Moreover, due to (7.20), L,~ must satisfy (7.10), which concludes the proof. 


Now, adapting the previous argument together with a reflection around ro := 
Lemma 7.3 provides us with the corresponding result for each of the annuli 


Ri +Ro 
2 ba 


AR,,Ry (X0) = {x ERY: 0< Ri <|x —xo| < Ro}. 
LEMMA 7.4. Suppose xo € RY, Ro > R} > 0,0 ER, p>l,y20and 


B(x) =f), r= |x —xol, B €C([R1, Ro]; 0, 00)), 


is the reflection around ro := Rit of some function B € C([ro, RJ; (0, 0©)), so that, in 


particular, B(R,) = B(R2). Then, for each ¢ > 0, the singular problem, 


—Au = hu — B(x)[dist(x, 9Ap,,R)(x0)) |”? in Ar,,R5 (X0), 


(7.21) 
u=Co on OAR, Ry (XO), 


possesses a positive solution L,(x) satisfying 


Boek L(x) ; L.(x) 
1 —e < liminf ———_ < limsup ————_ <l+e, (7.22) 
5(x)0 B[d(x)] s(x)l0 B[S(x)] 


where a and B are given by (7.11) and 


Ry —|x—xo| ifro <|x — xo] < Ro, 
6(x) = dist(x, 9 AR, Ro (X0)) = |x —xo|— Ry if Ry < |x —xo| <ro. 


286 J. Lépez-Gomez 
7.3. Proof of Propositions 7.1 and 7.2 
As it will be clear later, the proof of Proposition 7.1 can be easily adapted to prove Propo- 
sition 7.2, as it is of a local nature around each of the points of the boundary of the under- 
lying domain. So, suppose (2.9), (2.10), 4 < 02 and L is a large positive solution of (7.1) 
in 92 \ 29,1. Pick 

xy € Ty =0(2\ 21). 
Since I is of class C?, there exist R > 0 and 59 > 0 such that 

Br(ti— Rmx) C2, Bray — Ray) NM = {x1}, (7.23) 
and, for each 6 € (0, do], 


Br(x1 —(R+4)my,) CB. (7.24) 


On the other hand, due to (2.10), given any n € (0, B(x1)), R > 0 can be shortened, if 
necessary, so that, for each 6 € [0, do], 


a> (B(x) —n)[dist, M)]"°? in Ba(x1 — (R +.4)mn). (7.25) 
As for each 6 € [0, 69] and x € Br(x; — (R+4)n,,), we have that 


dist(x, I) > dist(x, Br(x1 — (R +6)mx,)) 
= R—|x —[x) —(R+4)ny, | 


(7.25) implies 

a(x) > (B(x) — n)(R—ra(x))""?, x € Br(x1 —(R+8)mn), (7.26) 
where 

r5(x) = |x — [x1 —(R+8)my, |]. 
Thanks to (7.24) and (7.26), for each 6 € (0, dg], the restriction 

L? = LBa(xy—(R+8)my,) (7.27) 


provides us with a classical subsolution (bounded) of the singular problem 


—Au =u — (B(x) — )(R—=15)YVuP in Ba(x; — (R+5)my,), 
u=oo on dBr(x1 — (R+)nx,). 
(7.28) 
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Now, consider the limiting problem at 6 = 0 


os (B(x1) — n)(R=ro)”PuP in Brix — Rny,), (7.29) 


u=o on 0Br(x; — Rn,, ). 
Subsequently, for each 6 € [0, dg], we shall denote 


ds(x) := dist(x, OBR (x1 —(R+ 5)n,,)) 
= R—|x — (x1 —(R+4)n,,)| 
= R—rs(x). 
Thanks to Lemma 7.3, for each ¢ > 0, the problem (7.29) possesses a solution, say Le, 
such that 
L 
lim sup a) a 
do(x)40 By (x1)[do(x)] ~ 


l+e, (7.30) 


where a (x1) is given by (7.3) and 


a(x1)(@ (x1) + er 
Bix) — 0 ; 


By (x1) = 
Subsequently, we fix ¢ > 0 and, for each 6 € (0, 50], consider the function Bea defined by 

Li(x):=Le(x + dny,), x € Br(x1 —(R+4)my,). 

By construction, 

lim L=L, (7.31) 
and, for each 6 € (0, do], ii provides us with a positive solution of (7.28). Thus, since the 
function ea defined in (7.27) is a positive classical subsolution of (7.28), it follows from 
Lemma 3.6 that, for each 6 € (0, do], 

L°<L? in Br(x1 —(R+4)mx,). 

Consequently, passing to the limit as 6 | 0, (7.27) and (7.31) imply 

L<Lez in Br(x — Rny,). 


In particular, for each t € (0, R), 


L(x — mMy,,) <Le(x1 — mMy,,) 
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and hence, 


L(x; — ty, ) Le(x1 — mMy,) 
B,(x1)[dist(xy — tny,, M)I-"") ~*~ By (x) (dist) — tny,, M1) # 9" 


On the other hand, by construction, we have that 
dist(x; — m,,, 171) =f = do(x1 — ty,) 


and so, passing to the limit as ¢ | 0 in the previous inequality, (7.30) gives 


F L(x = my, ) 
lim sup : <1lt+e. 
110 By(x1)[dist(x; — tm,,, 1) ]-%@v 


As this inequality holds for each sufficiently small 7 > 0 and e > 0, it is apparent that 


F L(x f= My, ) 
lim sup - < 
140 B(x1)[dist(x; — tm,,, M)]-%@v 


1, (7.32) 


where a and B are given by (7.3). Consequently, to complete the proof of (7.2) it remains 
to show that 


etn L(x = mM,, ) 
1 < liminf - ‘ 
110 =B(x;)[dist(x; — tny,, T\)|-¢@0 


(7.33) 


To prove (7.33) we will construct a large subsolution having the appropriate growth at 
x, € I. Since I, is smooth, there exist Ro > R, > O and dg > O such that 


ARr,,R) (41 + Rimy,) 1 = {24}, 


Q\ 21 CF) Arey (x1 + (Ri + 4)nx) 
5€[0, 59] 


and 

2\ 201.C AR,,(Ri+R)/2(41 + Rny,), 
which can be accomplished by taking a sufficiently small R; > 0 and a sufficiently large 
Ro > R,. Now, fix a sufficiently small 7 > 0. Thanks to (2.10), there exists a radially 
symmetric function 

a : AR,,Ry(X1 =f Rinx,) ag [0, oo) 


such that 


axa sup a+l in 2\ Qo1, 
Q\2o1 
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and, for each x € Ar,_r, (11 + Riny,), 

G(x) = b(|x — x1 — Rimy,|)[dist(x, AR, x, Orr + Rimy,)) ]/ 0” 
for some b € C([R1, R2]; (0, 00)) satisfying 

b(R1) = B(x) +07. 


Moreover, by enlarging R2, if necessary, one can assume that b is the reflection around 
Rit Re of a continuous positive function. Actually, by shortening 50, if necessary, we can 
assume that it satisfies all the requirements of the proof of (7.32). 

Subsequently, for each 6 € [0, 59], we consider the singular auxiliary problem 


—Au=du—a(-+6ny,)u? in AR,.Ro (x1 + (Ri + 8)nx,), (7.34) 

u=oo on JAR, Ry (x1 + (R + 4)my, ). i 
Fix a sufficiently small e > 0. Thanks to Lemma 7.4, for 6 = 0, (7.34) possesses a positive 
solution £, such that 


1—e< liminf Fe() 


: 7.35 
Do) 10 By(x1)[Do(x)] ? mest 


where a(x 1) is given by (7.3), 


oe 


Bits) =| Ban +n 


and, for each x € Ar, pr, (x1 + Rin,,) sufficiently close to I}, 
Do(x) := dist(x, 9AR,,r, (41 + Rimy,)) = |x — (1 + Rimy,)| — Ri. 
Now, for each 6 € (0, 59], consider the function rss defined by 
L3(x) = Le(x — Smy,), x € Any, Ry (x1 + (R + 8)ny,). 
By construction, 
lim Lo = Le. (7.36) 
Moreover, for each 6 € (0, do], the restriction 


6 = 
Lely Ao, 
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is a classical (bounded) subsolution of the singular problem 


| —Au=hu-—auP in? \ 201; 


u=oo on I 
since a > a. Thus, it follows from Lemma 3.6 that, for each 6 € (0, do], 


L<L inQ\Qou. 
Consequently, passing to the limit as 6 | 0, (7.36) implies 
Le<b° mR \ Qoi: 
In particular, for each t € (0, R), 
L_(x1 — tmy,) < L(x; — my,,) 
and hence, 


L¢_(x1 — tny,) L(x — tmy,) 
By (x1 )[dist(x1 — m,,, M)]-"°) ~ B,C) [distr — tny,, My) -# 0" 


On the other hand, by construction, we have that 
dist(x; — m,,, 1) =t = Do(x1 — my,) 


and so, passing to the limit as ¢ | 0 in the previous inequality, (7.35) implies 


L(x; — tn 
1—e <liminf AOS xy) 
110 By (x1)[dist(x1 — ty, , M))-¢e 


As this inequality holds true for each sufficiently small 7 > 0 and ¢ > 0, (7.33) holds. 
Therefore, by (7.32), the proof of (7.2) is concluded. Condition (7.4) is a direct conse- 
quence from (7.2). This concludes the proof of Proposition 7.1. At this stage, the validity 
of Proposition 7.2 should be apparent. 


7.4. Proof of Theorems 2.6 and 2.7 
Suppose (2.9), (2.10), and pick A < o2. Subsequently, we set 
.— 7 min .— 7 max t= oO, 
Ly:= Lis 2\@o1)" Lo:= Ley Q\Poal? D:=2\ 2o1- 
Theorem 2.6 establishes that L; = L2. By construction, we already know that 


Ly < Lp. 
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Moreover, thanks to Lemma 5.1, (5.24) and (5.26) imply 

Li(x)>0, xeD. 
LEMMA 7.5. Suppose L; < L2. Then, for each x € D, 

L1(x) < L(x). (7.37) 


PROOF. We proceed by contradiction. In the contrary case, there exist x9 € D and R > 0 
such that Br(xo) C D, Li(x) < L2(x) for each x € Br(xo) and L1(y) = L2(y) for some 
y € OBr(xo). Now, consider the problem 


( —Au=hu—au? in Br(xo), (7.38) 


u=L2 on 0Br(x0). 


If Ly = Lz on 0Br(x9) then, thanks to Theorem 3.5, L; = L2 in Br (xo), which contradicts 
L, < Lo in Br(x). Thus, L; < Lz on OBr(xo), and hence, L, is a positive strict subso- 
lution of (7.38), whose unique solution is Lz. So, thanks to Lemma 3.6, Lz — L; > 0. 
Consequently, since L2(y) — L1(y) = 0, we have that 


d(L2 — L}) y — x0 
Se 0, =, 
any (y) <0, ny R 


and therefore, for each sufficiently small t > 0, 


Lo(y +tny) < Lily +tny), 


which contradicts L; < L2, so concluding the proof of (7.37). 


Subsequently, we consider the function g defined through 


£1) 
aT 


, xed. (7.39) 


As an immediate consequence from the previous properties, the function qg is well defined 
in D and, actually, it is a function of class C?+“(D) such that 


O0<q(x) <1 foreachxeD. (7.40) 
Moreover, thanks to Proposition 7.1, 


ie —m,,)=1 foreach x; ¢ I) =aD, (7.41) 
t 


and, due to Lemma 7.5, 


0<q(x) <1 foreachx Ee D (7.42) 
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if L) < Lo. 
The following lemma is the basic technical tool to prove Theorems 2.6 and 2.7. 


LEMMA 7.6. Suppose q admits a continuous extension Q € C(D). Then, L = L3. 
PROOF. Let QEC (D) be a continuous extension of g. Then, thanks to (7.40) and (7.41), 


0< Q=q <1in D and Q =1 on OD. Moreover, differentiating the identity L} = QL2 
gives 


AL; = —L2AQ — 2(VL2, VQ) — QALd, 
and hence, 
AL, — aL} = —L2AQ — 2(VL2, VQ) + O(AL2 — aL). 
Consequently, dividing by L2 and rearranging terms, we find that 


sho = 2f <2, vo)= ag(Le-'—L?"') 50. 


Now, for each sufficiently large n € N, say n > no, we consider the approximating open 
sets 


1 
Dy = {* € D: dist(x, 0D) > “+ 
n 


Thanks to the maximum principle, for each n 2 no, minp, Q must be taken at some point 
x} € dD, nn Actually, this is a consequence from Theorem 3.1 applied to Q — miNp, p, 2: By 
construction, the sequence xt approximates I = 0D as n + oo. Thus, there exists x1 € I) 
and a subsequence of x/', again labeled by n, such that 


lim xf = x1. 
ntoo 
Therefore, 


1= Q(x) = a Q(x) = = lim minQ = min Q, 


ntoo D,, 


and consequently, Q = | in D, which concludes the proof. 


As an immediate consequence from the proof of Lemma 7.6, it is apparent that 


lim inf q sang <limsupg = upg = =1 


XX] xXx] 


if L; < L2. Moreover, the following uniqueness result holds. 
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LEMMA 7.7. Under the assumptions of Lemma 7.3 and Lemma 7.4, each of the problems 
(7.9) and (7.21) possesses a unique solution. Moreover, the solution is radially symmetric. 


PROOF. Throughout this proof, we consider 
2 €{Br(xo), Ary, R(x0)} 


and, for sufficiently large n, 
. 1 
Qn = 4x € 2: dist(x,02) > —}. 
n 


Going back to the proof of Proposition 4.7, it is apparent, by construction, that L; := Li 
and Li 2y] are radially symmetric. Thus, 


bee hy oy m baa) 


also is radially symmetric. Therefore, the quotient of these solutions, g = L;/Lz, is radially 
symmetric as well. 

On the other hand, adapting the proof of Propositions 7.1 and 7.2 to the domain 2, it is 
rather clear that, for each x; € 092, 


_ Lj — ty) 
lim" =1, je {1,2}, 7.43 
eer je {2} (7.43) 
where a and B are given by (7.11). Hence, 


rik —mMy,)=1 foreach x; € 092. (7.44) 
t 


As q is radially symmetric, due to (7.44), qg admits a continuous extension Q € C(Q), 
and therefore, adapting Lemma 7.6 to cover the present situation, we obtain that L; = Lo, 
which concludes the proof. 


Subsequently, in order to refine it, we go back to the proof of Proposition 7.1. By 
Lemma 7.7, we already know that, for every x; € I), each of the auxiliary problems, 
(7.29) and 


a in Ar,,R,(%1 + Rimy,), (7.45) 


u=oo on 0AR,,R(%1 + Rnyx,), 


possesses a unique positive solution. Let denote them by Le and ae , respectively. Note 
that in the proof of Proposition 7.1 the constants 59, R, R; and R»2 can be chosen to be 
independent of x; € I since I is of class C. Subsequently, instead of arguing with the 
large solutions Lz and £, whose existence was guaranteed by Lemmas 7.3 and 7.4, we 
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repeat the argument of the proof of Proposition 7.1 using Ee and be Then, for every 
n >0, x, € I andt € (0, R), we find that 


Lo (1 — tMy,) | LO —tny,) — Lo! G1 — tm) 
B(x te) * Bex )t-8@D BE) 


and, consequently, 


By(x1) £o' 1 — tm) | LO —tmy,) — By(1) Lo! G1 — tmy,) 
B(x1) ByQxy)t~@@) * Box )t-"@0 Bx) By (x) t7#D * 


(7.46) 


Note that in the special case when a(x,) and B(x,) are constant the large solutions 
Le and ope are translations of a fixed profile along each of the points at a distance R 
from I, and therefore, by (7.43), 


x 
Lo (x, -— my,,) _ 


EG = my,,) 
im ———_———_— = | 
110 By(ayyt@e) 


= lim ——_ 7.47 
110 By(x1)t-%en ie 
uniformly in x; € J. Thus, passing to the limit as t | 0 in (7.46) we obtain that 


BiG) — ning LOT Oe) i E(x — Mx) — BG) 
Ba) <0) BOayyt@00 Sry) BGayt-@e0 S BG) 


(7.48) 


uniformly in x; € I. Consequently, since 


By (x1) : By, (x1) 
m —— = l1=lim 
nO B(x1) nO B(x) 


uniformly in x; € I), 


it follows from (7.48) that 


L(x - tMmy,) = 


at Bapmean =1 uniformly inx,; el), (7.49) 


which, in particular, entails the continuity of the quotient function q defined in (7.39) and, 
thanks to Lemma 7.6, concludes the proof of the uniqueness in this special case. 

In our general setting, the proof is completed if we are able to show that (7.47) is as well 
satisfied uniformly in x; € I). This is easily realized by having a careful look at the proof 
of Lemma 7.3, which is based upon the construction of the supersolution 


2 
We(r) = A+ B,() (R—-r)™, By :=(1+8)B, 


and the subsolution 


2 
vw) -=max{0,c+ 8-() (R-ry*, B_:=(1—«)B. 
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Rereading the technical details of their constructions, it is rather obvious that the constants 
A and C can be chosen to be the same for a and 6(R), and, hence, B, varying in any 
compact subset of (0, 00). Therefore, 


lj Welr) = By F vo) B_ 
mR B(R—r)-* B mR B(R—r)-” B 


for a and 6(R) varying in any compact subset of (0, 00). As a(x;) and 6(x1) are contin- 
uous functions of x; € I and I, is compact, (7.47) occurs uniformly in x; € I, which 
concludes the proof of Theorem 2.6. The proof of Theorem 2.7 follows by repeating the 
argument along the remaining component of 0£2_. 


7.5. Proof of Theorem 2.8 

Throughout this subsection we suppose the assumptions of Theorem 2.7 are satisfied. Un- 
der these assumptions, Theorem 2.6 can be applied and hence, for each 4 € R, (1.9) has 
a unique large solution 1 in §2_, denoted by Li,,.@_}, and, for each A < 09, it has a unique 
large solution in {2 \ §2o,;, denoted by L,,_ Q\2r1" Theorem 2.8 will follow after a se- 


ries of lemmas. The next result shows the strong monotonicity of these large solutions as 
functions of the parameter A. 


LEMMA 7.8. For each i, w € R, A < ft, one has that 
(a) Lp,@_1(x) < Ltp.@_(x) for every x € Q_; = 
(b) Lin,.2\ 211) < Leiy,.2\ B11) for every x € 2 \ 2,1 provided ju < 02. 


PROOF. By construction, we already know that 


Epa) = im 62,.0_.M) and Pu.o|= fim Ou.2_.M)- 


Moreover, for each M > 0, 

01.,2_,M] K p,2_,M) in Q_. 
Therefore, passing to the limit as M + 00 gives 

Lae) < Le] m2. 
Note that, necessarily, 

Lp,ea_] < Ltw,e@_] in Q- (7.50) 
since Lj,,2_] = Liy,@_] implies 4 = «4, which contradicts 4 < 4. Now, we proceed by 
contradiction. Suppose part (a) is not satisfied. Then, there exist x9 € 2_ and R > 0 such 


that Br(x0) C 2_, 


Lya,a_|(*) < Liyp,2_|) for each x € Br(xo) (7.51) 
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and 

Lp,e|) = Lty,2_10) for some y € dBr(x0). (7.52) 
Now, consider the auxiliary problem 


| —Au=aAu—au? in Br(x0), (7.53) 


u= Liy,2_] on OBR (xo). 


If Lpa,a_] = Liy,g_] On OBR(xo), then, thanks to Theorem 3.5, Ly,,@_) = Liy,2_] 
in Br(xo), which contradicts (7.51). Thus, 


Ly,2_] < Lty,a_] on dBR(x0). 


Hence, Ly,,,2_] is a positive strict subsolution of (7.53), whose unique solution is Ly,,,_]. 
So, thanks to Lemma 3.6, 


Liy,e_-)— Lp,e1)>> 90 in Br(x0o). 
Consequently, it follows from (7.52) that 


I(Lfy,2_1 — Lp,a_)) 
any 


(y) <0, ny := —— 


and therefore, for each sufficiently small t > 0, 
Lip,a_|(y + tny) < Lp,e_\(y + tny), 


which contradicts (7.50). Consequently, part (a) holds true. The previous proof adapts mu- 
tatis mutantis to prove part (b). 


The next result provides us with the continuity of the large solutions as functions of the 
parameter A. 


LEMMA 7.9. For each x € Q_ the map 

AERP Lye) (7.54) 
is continuous. Similarly, for each x € 2 \ Qo,1, the map 

XE (—C, 02) B Lia,.2\ 211) (7.55) 


is continuous. 
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PROOF. Thanks to Lemma 7.8(a), for each 2 € R, the point-wise limit 
Ly :=limLyp~¢,2_] 
eL0 
is well defined and finite, since 0 < €2 < €; implies 


Lia —e1,@_-10) < Lp-er,@_1%) < Lye), x EQ. 


Moreover, by the compactness of (—A)~!, it provides us with a large positive solution 
of (1.9) in Q_; necessarily L},,@_}, by uniqueness. Thus, 


L = lim Ly, : 
[A,Q_] a [A—e,.2_] 
Similarly, 0 < ¢2 < €; implies 
Late, 210) > Liater,e_1) > Lp,ei%), xe Q_, 
and consequently, 
lim L =L é 
210 [Ate, 2_] [A,2_] 


which shows the continuity of (7.54). Adapting this argument, the continuity of (7.55) 
follows readily. 


Finally, the relations (2.16) follow from (2.5) and (2.7), by the uniqueness of the underly- 
ing large positive solutions, which is guaranteed by Theorems 2.6 and 2.7. This concludes 
the proof of Theorem 2.8. 


8. Relevant bibliography and further results 


The most pioneering result concerning the positive solutions of (1.8) is by Brezis and 
Oswald [8], Theorem 1, where it was shown, using variational methods, that (1.8) possesses 
a positive solution, necessarily unique, if and only if 


a[—A —ao(x), 2] <0 <o[—A — ayo(x), 2], (8.1) 
where ao(x) and dgo(x) are the functions defined through 


ao(x) := lim(A — a(x) f(x,u)) =a 


and 


—oo ifxe Q_, 


oo (x) = Jim (a0) For) ={ Lee 2. 
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Although it is rather obvious that the first inequality of (8.1) becomes 1 > oo, it is far from 
easy to realize why the second inequality should become 


A <o, =oa[—A, 2,1], 


in order to provide us with the existence interval 4 € (00, 01) given by Theorem 2.3 here. 
Actually, this is an easy consequence from an extremely sharp result going back to [41], 
according with it one has that 


lim o[-A + af(,u), 2) =o1-A, 1) =91. (8.2) 


Indeed, due to (8.2), (8.1) becomes into 
09 <A <0}. (8.3) 


Another significant pioneering contribution was done by Ouyang [62], as a part of his 
Ph.D. Dissertation on Yamabe’s problem [68] under the supervision of 
W.-M. Ni. Combining global continuation with the existence of uniform a priori bounds in 
compact subsets of A € (—oo, 01), Ouyang [62] established that, under assumption (2.9), 
condition (8.3) characterizes the existence of positive solutions of (1.8) and that 


as lp. 2111222) =O. (8.4) 
Later, Ambrosetti and Gamez [4] and del Pino [26] could improve (8.4) up to get 

lim | @f,,.2] I] t20(2) = 08, (8.5) 

Ato 


though in none of these works any explicit mention was made towards the problem of 
analyzing the different role played by each of the components of a~!(0), 29,1 and 29,2, 
in ascertaining the dynamics of (1.1). 

The first general characterizations of the existence of positive solutions for a general- 
ized class of logistic models including the basic prototype (1.8) were obtained by Fraile 
et al. [29] as a consequence from the method of sub- and supersolutions. In [29], instead 
of —A, a general elliptic operator of second-order subject to rather general boundary con- 
ditions was considered. At the present stage of this monograph, the reader should be fully 
convinced that the method of sub- and supersolutions is the best available method to deal 
with generalized sublinear problems, since the supersolution itself provides us with the 
exact shape profile of the positive solutions of (1.8) for A > oo separated away from o9; 
for A ~ oo, the solution looks like the subsolution of the problem. Besides this tremendous 
advantage, the method of sub- and supersolutions provides us simultaneously with the 
global attractive character of the maximal nonnegative solution of (1.8) within the range 
2 € (—o, 01). Undoubtedly, [29] has been a milestone for the further development of the 
theory that we have exposed in this monograph. Actually, the problem of the analysis of the 
asymptotic behavior of the solutions of (1.1) for 4 > o1 was originally addressed in [29], 
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where it was shown that the solutions of (1.1) must be unbounded, as f 4 00, within 29,1. 
Most of the results of [29] were obtained during the academic year 1993-1994, as a result 
of a question raised by P. Koch and S. Merino to the author during his first visit to Ziirich 
University in June 1993. The paper was submitted for publication on November 1994. 

According to the proof of Theorem 2.3 in Section 5, for each A € (0, 01), the positive 
supersolution of (1.8) has the form «®, where @ is the function defined in (5.7) for a 
sufficiently large « > 1 that blows up as A 4 01. Quite strikingly, ® is the supersolution 
constructed in [41] to prove (8.2). This crucial bisociation, besides sharpening the paradig- 
matic theorem of Brezis and Oswald [8], enjoys a huge interest in its own right, because 
of its number of applications in Mathematical Biology (cf. [11,12,42], and the references 
therein), in the study of linear weighted boundary value problems (cf. [41] and [43]), and 
in the semiclassical analysis of linear oscillators at degenerate wells (cf. [22], where it 
was used to solve some classical open problems proposed by Simon [66]). Bisociation...a 
word coined by the political and scientific writer A. Koestler for designating unexpected — 
sharply hidden — connections between a priori unrelated separated fields (cf. [9]). 

According to Theorem 2.3, the mapping A +> @,,,Q] is differentiable and strictly point- 
wise increasing. Moreover, by (2.6), 9,0] bifurcates from u = 0 at A = oo and, due 
to (2.7), 


Jim O1,,a\(%) =00 for each x € 29,1 \ 92. (8.6) 
oO! 


The fact that (8.6) occurs in §29,1 goes back to [45], Theorem 2.4, which was submitted for 
publication on August 1996, thought it appeared in 2000. The proof given in Section 5 is 
the original one given in [45]. It should be noted that (8.6) extremely sharpens (8.5). 

In Figure 10 we have represented 6), (x) versus A € (09,01) for a given x € 9291. 
Thanks to (8.6), the diagram exhibits a bifurcation from infinity at 1 = 01. In Figure 10 
stable solutions are indicated by solid lines, and unstable solutions by dashed lines. The 


Fig. 10. The steady-states of (1.8). 
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state u = 0 loses stability as A crosses oo, such stability being gained by 6,2]. By Theo- 
rem 2.4, local stability actually entails global attractiveness. It is remarkable the significant 
difference between the diagram shown by Figure 10 and the diagram of the classical pos- 
itive solutions that has been already inserted in Figure 2, where the curve At> @,,.2](x) 
is bounded at A = 0). The difference coming from the fact that, thanks to (2.7), for each 
xE2\ 201 one has that 


. _— ymin 
Jim 62.0108) = Liptay my) <2 (8.7) 


in severe contrast with (8.6). Bifurcation diagrams might drastically change according to 
the magnitude chosen to represent it, as it actually occurs here in, of course. 
Subsequently, we consider the compact set K defined by 


1 
K:= {x € Q: dist(x, dQ) > *} 
n 


for a sufficiently large n € N (see Figure 1). Thanks to the Harnack inequality, for each 
X € (69, 01) there exists a constant C, > O such that 


max Ofa,2] < Cy min 62,9). (8.8) 


Thus, if there are e > 0 and C > 0 for which 


sup Cy, <C, (8.9) 


01—-&<A<o| 
then, by (8.6) and (8.8), we would get 


lim 6,,@]=00o uniformly in K (8.10) 
Ato : 


and therefore, [2,2], 00 < 4 < 01, would exhibit entire blow up in K as A 4 01, which 
contradicts (8.7). Consequently, (8.9) fails to be true. Hence, 


sup Cy, =o. (8.11) 


01—&<A<o| 


As a consequence, the Harnack inequality fails to be true uniformly in compact intervals 
of 4 € R for general nonlinear problems, which makes specially interesting (8.6) and (8.7). 
Actually, before developing the mathematical contains of this monograph, the validity 
of (8.9) was so much appealing that several experts in PDEs tried to convince the au- 
thor of the complete blow up of 61.2] as A t o1. Finally, it was in [31], where (8.7) was 
shown to occur in the very special case when (29,2 = % and x € §2_, by using the minimal 
large solutions in small moving balls in order to get uniform a priori bounds within {2_. 
Although this — apparent — paradox was definitively solved in October 1996, [31] appeared 
in 1998. 
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Some time later we learned that a huge industry on large solutions was already available 
at our disposal in the literature (e.g., [6,67] and [57]). However, it should be emphasized 
that the original a priori bounds of Keller [38] and Osserman [61] do not apply straight 
away to (1.9), and that, occasionally, they have been used in the wrong way (cf. [44] for 
further technical details). 

The interested readers are sent to [31], Figure 2.2, to see a numerical plot illustrating 


the stabilization of the positive solution 6, Q] to the minimal metasolution een ae 
; 0,1 


as A t 01. Actually, that was the first metasolution constructed in the literature in the con- 
text of population dynamics. 

On February 1997, combining some classical methods from the calculus of variations 
going back to [18] and [37] with the method of sub and supersolutions, Lé6pez-Gémez and 
Sabina de Lis [56] could definitively prove the validity of (8.6) along I — in the special 
case when a € C! and 20,2 = G — so getting (2.7). This result was later generalized by 
Gomez-Refiasco and Lépez-Gomez [36], to cover the general radially symmetric case, and 
by Du and Huang [28], in order to eliminate the smoothness assumption on a(x) from the 
theorem of [56]. Actually, the proof of this fact given in Section 5 (see the proof of (5.45)) 
follows [28], where the proof of the classical Hopf lemma given by Protter and Weinberger 
[63] was comfortably adapted. 

The concept of metasolution and most of Theorems 2.1—2.3 go back to [36] and [34], 
which was Gomez-Refiasco Ph.D. Dissertation Thesis under the supervision of the author. 
The results of [36] sow light during the summer of 1998. Then, the manuscript was sent 
to H. Brezis on September 1998 for submission to Archive for Rational Mechanics and 
Analysis, though, quite unfortunately, on March 4th 1999, it was formally rejected. Further, 
it was sent to P.H. Rabinowitz for submission to Nonlinear Analysis. Theory Methods and 
Applications, where it finally appeared in 2002, after three years time. Fixing dates might 
be imperative to avoid any eventual priority dispute. 

The original theory developed in [36] was extraordinarily generalized and refined 
in [44]. Actually, Theorems 2.1—2.3 and most of Theorem 2.4, in their full generality, 
go back to [36] and [44]. Unfortunately, the proof of Theorem 2.4(c) and (d) given in [44] 
has a serious gap that has been filled in [51]. The author was aware of that gap from 
a beautiful question raised by H. Amann during a seminar delivered by the author in 
the Institute of Mathematics of the University of Ziirich on June 2002. Although Theo- 
rem 2.4(d)(ii) had been already obtained by Du and Huang [28] in the very special case 
when S20,2 = Y, parts (c), (d)(ii) and, actually, the whole theorem in its full generality 
go back to [44] and [51]. Nevertheless, since 20,2 #4 ¥, obtaining the a priori bounds in 
9 \\ Qo, is extraordinarily more involved than in the very special case when 929,27 = J. The 
main problem coming from the fact that one has to adapt the available proof of part (d), 
obtained for the special case when §20,2 = Y, to study the singular counterpart of the prob- 
lem when u|, (2\21) = © and {29,2 # Y, this being an extremely delicate matter from the 
technical point of view. Actually, the level of difficulty is much higher than passing from 
the classical logistic equation, where a(x) is bounded away from zero, to the degenerate 
situation when a(x) vanishes somewhere, as one must deal with a degenerate problem for 
a singular boundary value problem when (20,2 4 J. 

Actually, during the celebration of the referred seminar in Ziirich, though H. Amann 
realized the fact that the limiting behavior of the increasing solutions is governed by the 
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minimal metasolution, he could not see at first glance the controlled behavior of the non- 
increasing solutions of (1.1) in between the minimal and the maximal metasolutions, which 
forced the author to check all technical details of the proofs given in [44] finding a mistake 
in the original proof (cf. [51] for further details). The proof of Theorem 2.4 given here goes 
back to [51], and, consequently, it is extremely indebted with the extraordinary intuition of 
H. Amann. It should be emphasized that Theorem 2.4 in its full generality was implicitly 
announced in the general discussion carried out in [36] four years before. 

More recently, Cirstea and Radulescu [17] have considered the following singular prob- 
lem 


| Au+au=D(x)ftu) in, (8.12) 


u=oo on 022, 


where @ is a smooth domain of RY, ae R, b>0, b # 0, is continuous and f € ¢} 
is a positive function satisfying the Keller-Osserman condition and such that f(u)/u is 
increasing in (0, oo). If we denote by oj the principal eigenvalue of —A in the region 
where b~! (0), then the main theorem of [17] reads as follows. 


THEOREM. Problem (8.12) has a solution if and only if a € (—&, 01). Moreover, in this 
case, the solution is positive. 


Incidentally, Cirstea and Radulescu [17] knowledge the readers that 


We point out that our framework in the above result includes the case when b vanishes at some 
points of 02, or even if b= 0 on 02. In this sense, our result responds to a question raised to one 
of us by Professor Haim Brezis in Paris, May 2001. 


The previous theorem follows as a direct consequence from the general theory developed in 
[36] and [44], and considerably tided up in this monograph. Actually, the problem studied 
in [17] had already been considered in [36]. 

Theorems 2.6 and 2.7 go back to [50]. Theorem 2.7 is a substantial improvement of [28], 
Theorem 2.1 and [32], Theorem 1, where it was imposed the substantially strongest as- 
sumption that 


a(x) = B[d(x)]”[1 + pd(x) + o(d(x))] as d(x) 1 0, (8.13) 


where d(x) := dist(x, 092_) and B > 0, y > 0, p € R are constant. So, in such case, 


a(x) ; 

lim — ——.=1 uniformly in x; €02_, 

xox B[d(x)]” 
while in Theorem 2.7 the weight function a(x) is allowed to decay to zero on 0S2_ at 
different rates according to each particular point x; € 0(Q_. Theorem 2.6 is completely 
new even in the simplest case when (8.13) is satisfied, since a(x) vanishes within (20,2, 
which is a situation not previously treated in the literature. 

It should be mentioned that all these results are substantial extensions of some pioneer- 

ing contributions of Loewner and Nirenberg [40], Kondratiev and Nikishin [39], Bandle 
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and Marcus [5—7] and Véron [67], who exclusively studied the simplest case when a(x) is 
bounded away from zero in 2. As we already know, in such case, large positive constants 
provide us with a priori bounds for the positive solutions of the underlying homogeneous 
Dirichlet boundary value problem, while if a(x) decays to zero somewhere on 0{2_, as it 
occurs in the case we are dealing with, live is much harder as large positive constants are 
not supersolutions anymore, and, in general, the a priori bounds of the positive solutions 
of those underlying problems are lost. Actually, explaining the huge differences between 
these two cases has been the main issue addressed in this monograph. 

As asserted by Theorem 2.7, the blow-up rates of the large solutions of (1.9) in 2_ 
depend upon the precise decay of a(x) at each of the points of 0(92_. Thus, to prove The- 
orem 2.7 we cannot adapt the proof of the corresponding counterparts of Du and Huang 
[28] and Garcia-Melian et al. [32], based on the construction of some appropriate global 
sub- and supersolutions. Instead of that, in Section 7 we have used a new localization 
method, which consists in constructing a local subsolution and a local supersolution sup- 
ported at each particular point of the boundary of the domain. Although this method goes 
back to [50], it should be noted that the proof given in [50] exclusively shows the validity 
of Propositions 7.1 and 7.2 here, since the proof of the fact that the quotient function g 
defined in (7.39) is continuous contains an important gap. Nevertheless, the main theorem 
is correct and all necessary technical details to complete it have been clarified in Section 7 
here. The same gap occurred in [25], where, besides characterizing the existence of large 
solutions for a general class of porous media equations of logistic type, the blow-up rates 
of these solutions in terms of the decay rates of a(x) and of the nonlinear diffusion rate 
were ascertained. 

Several other recent works dealing with similar but distinct problems are [14-16], 
and [58]. Their main goal is obtaining the blow-up rates of the large solutions of (1.9) 
in §2_ for large classes of f’s keeping a(x) bounded away from zero. 

Incidentally, [50] was submitted to the Journal of Differential Equations on January 18th 
2002 and the referee’s report, recommending rejection, was received on May 23rd 2003. 
During that period, appeared [14-16] and [58], whose publication was the main argument 
exhibited by the referee to recommend rejection of [50]. At the end of the day, the editors 
of the Journal of Differential Equations decided to publish it. 

Further, it turns out that the minimal metasolutions of (1.1) that are stable can be also 
obtained by adopting the approach of [47], where (1.8) versus the perturbed problem, 


Ce in 2, (8.14) 


u=0 on 022, 


were analyzed. In (8.14), e > 0 should be regarded as a perturbing parameter in order 
to transform (1.8) into a classical logistic problem where the weight function in front of 
the nonlinearity is positive and bounded away from zero. Thanks to Theorem 4.2 (with 
D = 2_ = 2), we already know that (8.14) possesses a positive solution if and only if 
A > 69, which is unique if it exists. Subsequently, we shall denote it by 4, ,@,¢). Then, 
though the proof will not be included here, the main theorem of [47] can be stated as 
follows. 


THEOREM 8.1. The following assertions are true: 
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1. lime jo a,.2,¢] = 9,2] 90 <A <o}. 


: — syprmin : 
2. lime 10 Of1.,.2,€] = WT 2\ ol if o1 < r< 02. 


3. lime jo a,2,¢] = Mi I ifA So. 


Consequently, there is a continuous transition between the dynamics of (1.1) and the 
trivial dynamics exhibited by the parabolic counterpart of (8.14). This should be a crucial 
property from the point of view of the eventual applications of the underlying theory to 
Population Dynamics, as it permits designing appropriate environments where the popula- 
tion exhibits a differentiated logistic behavior according to the several patches that conform 
the habitat. Also, it should be extremely relevant from the point of view of the numerical 
approximation of the dynamics of (1.8), as it permits to compute the minimal metasolutions 
that are stable through the following scheme: 

1. Computing the global curve of positive solutions of (8.14) by performing a global 

numerical continuation in 1. 
2. Pick any of these positive solutions and then perform a global continuation in ¢, to 
approximate the corresponding metasolution. 
Such strategies have already been shown to be pivotal to compute isolated components 
of positive solutions in wide classes of reaction diffusion systems and weighted nonlinear 
boundary value problems (e.g., [13,46] and [54]). 

Another mechanism to approximate the dynamics of (1.1) through a model exhibiting an 
asymptotically bounded population profile, whose level might be designed according to the 
region of the inhabiting area, was given in [23] by means of the classical porous medium 
equation. Most precisely, in [23] we considered the following differential equation with 
nonlinear diffusion 


—Aw”"™=)w-—aw? inQ, 
(8.15) 


w=0 on 022, 


where m > 1, in order to obtain the following result, whose proof is omitted here. 


THEOREM 8.2. Suppose 1 <m < p. Then (8.15) possesses a positive solution (unique) if 
and only if > 0. Moreover, if we denote it by Wi).,2,m), then, setting 


O4,.2,m] = Wih.2.m) 


the following properties are satisfied: 

1. limmy1 Of.,2,m] =0 f0 <A <9. 

2? limmn)1 O12.,2,m] — OfA,2] ifo9 <A <0}. 
min _ 
[A, 2\ 20,1 
4. limm)1 9[2,2,m] = M2] ifr S02. 


3. limmy1 O[a,.2,m] = Dt fol <A <a. 


Metasolutions have also shown to be extremely relevant in analyzing the dynamics of 
very large classes of reaction diffusion systems (cf. [27,49] and [21]), and of very general 
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classes of indefinite superlinear parabolic problems, where the weight function a(x) is 
allowed to change sign within 2. 

In order to sketch how metasolutions arise in the context of indefinite superlinear prob- 
lems, suppose a satisfies the following 


a'(0) =20,1UIR2o2, a '(0,0))=2_, — a! ((—00,0)) = Ro, 
(8.16) 


and denote by at and a™ the positive and negative parts of a, 


whose supports are §2_ and §20,2, respectively. Then, by bringing together the theory devel- 
oped in this monograph with the techniques and results of L6pez-Gomez and Quittner [55] 
and Quittner and Simondon [64], one can get the following result, which is a sort of sum- 
mary of the main findings of [52]. 


THEOREM 8.3. Suppose (8.16), (2.9), A > 01, and uo > 0 satisfies 
—Aup < Aug —atu?. 


Then, the following properties are satisfied: 
1. For each X € (00, 01), there exists €(A) > 0 such that \|a~ lei 5) < €(A) implies 


lim u[,,21¢, t5 Uo) = Oa,2], 
ttoo 


where 61), Stands for the minimal positive solution of (1.8), whose existence is 
guaranteed by Amann and Lépez-Goémez [3]. 

2. For each d € (00, 01), there exists K(A) > e(A) such that up,,Q|(, ts uo) blows Ss up 
in a finite time if |la~ |le(@,,) > (A). Moreover, the blow up is complete in 202 
if p—1> 0 is sufficiently small. Furthermore, in this case, uj,,.Q\(, t; uo) approxi- 


mates eT aaa as t * ©, though, in 20.2, infinity is reached in a finite time. 


3. For each 2X € [o}, . there exists €(A) > 0 such that ||a~ lei = €(A) implies 


2 F min 
a Upa,Q\C, t; uo) = M [A, 2\ 201)’ 


where MMV Bau stands for the minimal metasolution of (1.9) supported 


in 2 \ 20,1. Note a a(x) changes sign in $2 \ 21. 

4. For each id € [o1, 02), there exists K(A) > €(A) such that up,Q\(,t; Uo) blows up 
in a finite time if la Ile,» > K(A). Moreover, the blow up is complete in 20,2 
if p —1> 0 is sufficiently small. Furthermore, in this case, uj,,Q\(, t; uo) approxi- 
mates me | as t t 00, though, in 20,2, infinity is reached in a finite time. 
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5. For each 0 2 02, upyr,a\(-, ts; uo) blows up in a finite time. Moreover, the blow up 
is complete in 20,2 if p — 1 > 0 is sufficiently small. Furthermore, in this case, 
Uupr,a](, ts Uo) approximates DI as t * 00, though, in 202; infinity is reached 
in a finite time. 


Consequently, though metasolutions arose in analyzing the most paradigmatic model 
of Population Dynamics, they seem to be crucial to understand the role of spatial het- 
erogeneities in wide areas of Science and Technology. Undoubtedly, within the next few 
years metasolutions will play a significant role in the modern theory of Partial Differential 
Equations, where using spatial heterogeneities is imperative in order to get more realistic 
models. 
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1. Introduction 


In this chapter we provide a survey of mathematical results concerning solutions of elliptic 
problems with nonlinear boundary conditions. We mean solutions of problems that can be 
written in the general form 
Lu=f(tu) inQ, 
fu) (1.1) 
Bu=g(u) ond. 


Here, and through this work, {2 is a bounded domain in RY with smooth boundary 02, 
Lu is a second-order elliptic operator and Bu is a boundary condition that involves 4, the 
outer normal derivative. 

Of importance in the study of boundary value problems for differential operators in 92 
are the Sobolev spaces and inequalities. Hence, Sobolev inequalities and their optimal 
constants is a subject of interest in the analysis of PDEs and related topics. It has been 
widely studied in the past by many authors and is still an area of intensive research. See, 
for instance, the book [15] and the survey [50] for recent developments in this field. 

When analyzing problems with nonlinear boundary conditions like (1.1) it turns out 
that among the Sobolev embeddings the Sobolev trace theorem plays a fundamental role. 
Also one is lead to the study of nonlinear boundary conditions when one tries to find out 
properties of the Sobolev trace best constant. 

Our main interest here is to look closely at this relation between nonlinear boundary 
conditions and the Sobolev trace theorem. 

Another motivation to study problems with nonlinear boundary conditions comes from 
geometry. One is lead to nonlinear boundary conditions when one performs a description 
of conformal deformations on Riemannian manifolds with boundary. Look at the results 
of Cherrier and Escobar [29,54,55]. In [53] and [105] a geometric problem in the half- 
space RY with nonlinear boundary conditions is studied. 

Also, nonlinear boundary conditions appear in a rather natural way in some physical 
models. For example, problem (1.1) can be thought of as a model for heat propagation. 
In this case u stands for the temperature and the normal derivative ou that appears in the 
boundary condition B(u) represents the heat flux. Hence the boundary condition represents 
a nonlinear radiation law at the boundary. This kind of boundary conditions appear also in 
combustion problems when the reaction happens only at the boundary of the container, for 
example, because of the presence of a solid catalyzer, see [99] for a justification. Eigen- 
value problems with the eigenvalue placed at the boundary condition, ae = hu, are studied 
since the pioneering work of Steklov, see [115]. 

There are works that consider fully nonlinear equations like F(x, u, Vu, Du) =0in 2 
with nonlinear boundary conditions, H(x,u, Vu) =0 on 092, where H is assumed to be 
strictly increasing with respect to Vu in the normal direction to 02 at x. See, for example, 
[16] and [89] where viscosity solutions are considered. There are also papers that deal with 
higher-order equations, for example in [72] a fourth-order problem is considered. How- 
ever, to simplify the exposition, we will be only concerned with second-order problems 
like (1.1). 
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Elliptic problems, Lu = f (wu), with Dirichlet boundary conditions, u|aq = 0, have been 
widely treated in the literature, see the survey [44] and references therein. Many of the 
known results that hold for Dirichlet boundary conditions have an analogous counterpart 
when dealing with nonlinear boundary conditions. However many times the proofs are 
different. We will try to emphasize the differences and similitudes between both types 
of boundary conditions. Therefore, a strong motivation to study elliptic problems with 
nonlinear boundary conditions is to see how the well-established theory for the Dirichlet 
problem extends to other situations (as nonlinear boundary conditions) and to develop new 
ideas and methods when the available theory is not applicable. These developments may 
have consequences for other related problems that do not involve necessarily nonlinear 
boundary conditions. 

We have to mention that there is a large amount of literature dealing with parabolic 
problems with nonlinear boundary conditions. In the last years there has been an increas- 
ing interest in the study of blow-up due to reaction at the boundary, both for scalar problems 
and for systems, see, for example, the surveys [34,77] and references therein. Often par- 
abolic results are related to elliptic results. For example, when every positive solution of 
a parabolic problem blows up there cannot exist any positive stationary solution. Hence 
we have a nonexistence result of positive solutions for the elliptic problem in this case, 
see [30], [31] and [81] for such type of results. The stability properties of a stationary solu- 
tion is also a problem to deal with, see, for example, [31] and [39]. Moreover, many times 
regularity results for elliptic and parabolic problems are related, see [4]. 

The References do not escape the usual rule of being incomplete. In general, we have 
listed those papers which are more close to the topics discussed here. But, even for those 
papers, the list is far from being exhaustive and we apologize for omissions. 


Organization of the chapter. The rest of the chapter contains eleven sections. They are 
organized by subject, however many times there are relations between them that we will try 
to outline. In some cases we will provide full proofs (or at least sketch the main arguments) 
in order to give the reader an idea of the involved techniques. In each section a change of 
subject or problem will be marked with Vv. 

Section 2. In this section we state some preliminaries relating the best Sobolev trace 
constant with problems with nonlinear boundary conditions and give some ideas about 
regularity results from J. Garcia-Azorero, I. Peral and the author that can be found in [81]. 

Section 3. In this section we see how to adapt usual variational techniques to deal with 
nonlinear boundary conditions. We follow ideas from M. Chipot, M. Fila, P. Quittner, 
J. Garcia-Azorero, I. Peral, K. Umezu, J. Fernandez Bonder and the author, see [31], [32], 
[71], [81] and [121]. 

Section 4. We collect some results in the half-space, RY , proved by B. Hu, X. Cabre, 
M. Chipot, M. Chlebik, I. Shafrir, M. Fila, Y. Park, W. Reichel, J. Sola-Morales, 
S. Terracini, Y. Li and M. Zhu, see [24], [30], [33], [87], [93], [106] and [117]. 

Section 5. Here we discuss about the results of A. Ambrosetti, Y. Li, A. Malchiodi, 
V. Felli, M. Ahmedou and J.F. Escobar, which have a strong geometrical motivation, the so- 
called Yamabe problem for manifolds with boundary. In this geometrical problem the crit- 
ical exponent for the Sobolev trace embedding appears. See [5], [53], [54], [55] and [60]. 
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Section 6. In this section we deal with the dependence of the best Sobolev trace constant 
on the domain for a subcritical exponent. We focus on families of domains obtained by 
expanding or contracting a fixed domain and obtain the asymptotic behavior of the best 
Sobolev trace constant. Also we prove that the first eigenvalue of an associated nonlinear 
Steklov-like eigenvalue problem is isolated and simple. We collect results of C. Flores, 
M. del Pino, S. Martinez, J. Fernandez Bonder and the author, [46], [66], [74] and [100]. 

Section 7. We look at symmetry of the extremals for the Sobolev trace embedding. In 
particular, we study when the extremals are radial if (2 is the ball of radius R, B(O, R). 
We report on the results of O. Torne, E. Lami-Dozo, J. Fernandez Bonder and the author, 
[65] and [92]. 

Section 8. In this section we consider the trace of functions that belong to a Sobolev 
space and vanish over some subset of §2. We look at the problem of optimizing the best 
Sobolev trace constant when varying the subset where the involved functions vanish keep- 
ing its area fixed. We follow ideas of J. Fernandez Bonder, N. Wolanski and the author, [76]. 

Section 9. Here we look at the Sobolev trace embedding with the critical exponent. 
The results presented in this section are mainly due to E. Abreu, P. Carriao, O. Miyagaki, 
D. Pierotti, S. Terracini, F Demengel, M. Motron, M. Chlebik, M. Fila, W. Reichel, 
F. Andreu, J. Mazon, J. Fernandez Bonder and the author, [1], [11], [35], [47], [75], [104], 
[108] and [109]. See also Section 5 for other results that involve the critical exponent. 

Section 10. Now we study the dependence of the Sobolev trace constant on the exponents 
involved. We rely on results of R. Ferreira, J. Fernandez Bonder and the author, [64]. 

Section 11. In this section we collect results concerning elliptic systems with nonlinear 
boundary conditions, from M. Schechter, W. Zou, S. Li, J. Fernandez Bonder, S. Martinez 
and the author, see [67], [68], [69], [70], [112] and [125]. 

Section 12. Finally we collect other results for problems with nonlinear boundary 
conditions, concerning maximum/antimaximum principle, isoperimetric inequalities, self- 
similar profiles for parabolic problems with blow-up, free boundaries, equations involving 
maximal monotone graphs and their relation with semigroup theory, resonance problems, 
the Fucik spectrum at the boundary, etc. In this section we do not provide any proofs and 
refer for details to the papers of F. Andreu, D. Arcoya, Ph. Benilan, F. Brock, M. Crandall, 
J. Davila, S. Martinez, JM. Mazon, M. Montenegro, P. Sacks, S. Segura de Leon, J. Toledo 
and the author. See [12], [14], [19], [23], [41], [42], [101] and [102]. 


Notations. We end the Introduction fixing some of the notation that will be used in the 
following sections. 

Along this chapter there are two measures involved, the usual Lebesgue measure in 
92 CRN and the surface measure on 382. With dx and do we denote the corresponding 
N- and (N — 1)-dimensional measures. Also we will use the notation | A| for the measure of 
the set A in its corresponding dimension, that is, if A is a set of dimension r, | A| stands for 
the r-dimensional measure of A. We will call the characteristic function of the set A as x4. 

With p. = p(N — 1)/(N — p) and p* = pN/(N — p) we denote the critical expo- 
nents for the Sobolev trace embedding W!-P(2) + L4(9Q2) and the Sobolev embedding 
W!P(2)H L"(2). S(2, P.q) Stands for the best Sobolev trace constant, see Section 2. 
Remark that we make explicit the dependence of the constant on the domain and on the 
involved exponents. This dependence will be analyzed throughout this work. 
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Let us look for a simple example where problems with nonlinear boundary conditions 
appear in a very natural way. To this end, let us first remark that in the study of elliptic and 
parabolic partial differential equations the Sobolev spaces are a very useful and versatile 
tool for their analysis. For general references on Sobolev spaces we cite [2]. 

Recall that the Sobolev space H '(Q) is defined as the space of L?() functions with 
weak first derivatives that also belong to L?(9). In H!(Q) we have a Hilbert space struc- 
ture. We consider the usual norm that comes from the inner product, 


wo)= f vuvodr+ f uvdx, 
2 Q 


1/2 
Wellies =(f IvuPax + f wd) 5 
2 2 


Given a smooth function (e.g., ue C 1(Q) C H'(2)) we can define the restriction to the 
boundary u|aq. It turns out that this restriction operator can be extended from smooth 
functions to H!(@) giving a linear continuous operator from H '(Q) to L'(8Q), if 
l<r<2y=2(N —1)/(N -2), 


that is, 


T:H'(2)> L' (dQ). 


This result is the very well-known Sobolev trace theorem. See, for example, [2]. The norm 
of this operator is given by 


S(2,2,r) = inf{llall F719): uw € H'(Q) with |lullZ-(99) = 1} 


Vul? + |u|? dx 
= inf Jill | : . (2.1) 
ueH(2)\HA(2) Cag lul” do)?!” 


This value S(§2, 2,7) is known as the best Sobolev trace constant. 

For values of r < 2, (subcritical values) we have that the trace operator is a compact 
operator, therefore an easy compactness argument proves that there exist extremals, that 
is, functions in H!(2) where the norm is attained. These extremals turn out to be weak 
solutions of 


Au=u in 22, a 
eaters on dQ, G2) 


where A is a Lagrange multiplier. 
For a weak solution of (2.2) we understand a function u € H!(@) that verifies 


[vuvears f war = [ Alul’~2uv do (2.3) 
2 2 a2 
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for every test function v € H '(Q). Remark that in (2.3) two measures (dx, the volume 
measure and do, the surface measure) are involved. If we assume the normalization of the 
extremal given by ||u||z"(aq) = 1, taking v = u in (2.3), we get that the Lagrange multi- 
plier is related to the best Sobolev trace constant given by (2.1). It holds, A = S(2, 2,r). 
Problem (2.2) has associated an energy functional 


1 5 2 |u|" 
F=f [Yul +|uldx— J 4——do. (2.4) 
2 a2 


In fact, critical points of (2.4) in H !(Q) are weak solutions of the problem (2.2) in the 
weak sense (2.3). 

An important case is when r = 2. In this case (2.2) becomes the linear eigenvalue prob- 
lem 


Au=u_ in82, 
ee on 02. 


Using the compactness of the embedding H !(92) S L?(8Q) itis obtained that there exists 
a sequence of eigenvalues 4, — oo and the first one corresponds to the best constant that 
we are looking for, see [71]. These eigenvalues can be regarded as the eigenvalues of the 
Dirichlet to Neumann map for the operator —A + J acting in the space H!(2). 

At this point, we have to mention the results of Escobar [57-59] for the Steklov eigen- 
value problem 


Ag=0 in, 
{ae 2% yp ondM. 
This problem was introduced by Steklov [115] and was initially studied by 
Calderon [25], because the set of eigenvalues for this problem coincides with the eigenval- 
ues for the Dirichlet to Neumann map. Escobar proves some estimates and isoperimetric 


results for this problem on manifolds. 
Going back to the Sobolev trace embedding in full generality, one can consider 


W!P(2)% L182), 


where W!+?(Q) is the usual Sobolev space of functions u € L?(Q) with Vu € (L?(2))% 
endowed with the norm 


1/p 
Walwiniay=(f val? dx + f ll? ax) 
2 2 


Then, problems with nonlinear boundary conditions also appear in a natural way when one 
considers the Sobolev trace inequality in W!-? (2) and L4(4Q), 


S D(N —-1) 
llMlicaaay S lll yyt.rcey ES ale ar 
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The best constant S is given by 


: So (Vul? + |u|? dx 
S(2,p,.qg= inf 7 
uvewh can wera) ag ult do e/a 


The extremals (if there exist) are weak solutions of 
Apu=|ul?-7u in Q, 
(2.5) 


|VulP-? 84 = Alul?-2u on a2. 


Here, Apu = div(|Vu|? ~2Vu) is the well-known operator called the p-Laplacian. Remark 
that (2.5) is a quasilinear elliptic problem. 
Also in this case we find an eigenvalue problem. When q = p, problem (2.5) becomes 


(oe |u|P~2u in Q, 


[VulP-?7 4 = Alu|P-2u on a2. 


This is a nonlinear eigenvalue problem. Also in this case it can be proved that there exists 
a sequence of variational eigenvalues A, — ov, see [71]. As for p = 2, the first eigenvalue, 
which is isolated and simple (see [100]), is related to the best constant for the Sobolev 
trace embedding. However, as happens for the eigenvalue problem for the p-Laplacian 
with Dirichlet boundary conditions, it is not known if the obtained sequence constitutes 
the whole spectrum. 

Now, for the sake of completeness, we will provide an answer for the question: Among 
the functions f : 092 — R, which are the trace of a function of W!P(2)? 

To answer this question we have to introduce the fractional Sobolev spaces. We follow 
the presentation made by Bourgain, Brezis and Mironescu in [21]. 


DEFINITION 2.1. For 0 <5 < 1, we define 


u(x) — u(y)? 
A |x—yl|NtsP 


W'?(A) = {« € L?(A): [wl]? p =) dx dy < 20] 
A 


with the norm ||u|lws»¢ay = llullzecay + (PU — 8))!/P lads, p- 


The quantity [-];,) is known as the Gagliardo seminorm. The factor (p(1 — s))!/P that 
appears in the definition of the norm guarantees that lims—,1 ||u||ws.p¢a) = |lUllwi.ecay> 
see [21]. 

Let us consider the quotient space W!:?(Q)/ Wo ‘?(Q2) with the quotient norm |||| = 
infy|yo=v\9@ ll Ullwi.ecq). We have the following theorem. 


THEOREM 2.1. For 1 < p < ov, the trace operator 


_Wh?(Q) 


SS rt W!-l/P-P(aQ) 
Wo? (2) 
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is a linear homeomorphism. 


v¥ Some remarks on regularity. Now we want to state some regularity results for ellip- 
tic problems with nonlinear boundary conditions. We are not going to provide the more 
general result nor enter into the details of the proofs. However we give a sketch of the 
arguments just to look at the ideas involved. Also we have to mention here that we are not 
facing any regularity constraints coming from domain regularity, since we are assuming 
that {2 is a smooth domain. See [51] for regularity results in polyhedra. 

Let us deal with a solution of 


—Autu=|ul?-2u in, 


gu — Aluli2u on 022, 


(2.6) 


with p and q critical or subcritical. Now we prove C%(&) estimates for the solutions 
of (2.6), see [81]. We include some details for the sake of completeness. 


THEOREM 2.2. Every weak solution of (2.6) with 1<q<2(N—-1/(N-2),1l<p< 
2N/(N — 2) belongs to C®% (2). 


First, we deal with the subcritical case. Namely, 1 < gq <2(N — 1)/(N —2), 1<p< 
2N/(N — 2). The idea is to adapt the classical bootstrapping argument, taking into account 
the nonlinear boundary condition. We start by recalling some linear results. 


PROPOSITION 2.1. 
(I) Assume that g € L'(92) with r > 2N/(N + 2) and let 6 € H!(Q) be the weak 
solution to 


—A = 2 in 
o+o=8 ink, (2.7) 


a¢ 0 on 082, 


then \|b|lw1.6.a) < Cllgilt(@) with B = Nr/(N —r) > 2. 
(I) Assume that h € L*(0Q2) with s > 2(N — 1)/N, and let w be the weak solution to 
problem 


—A =0 in82, 
wow in (28) 


wh on aQ. 
Then |W |l wir (a) < CllAllisaa) with y = Ns/(N — 1) > 2. 


PROOF. Part (I) can be considered as the simplest case of the results in [114]. In this case 
the proof is easier: just integrating by parts we find 


[[vovoar+ f aoax < llellerolelle@y 
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with : + 4 = |, and by Sobolev embedding we can take a test function p € w!-6' (2) with 
B’ = Nr'/(N +r’). As a consequence, using Proposition 1 of [29] we get ¢ € W'4(Q) 
and IP lw.) < Cl|lgllz7(a), where B = Nr/(N —r), and since r > 2N/(N + 2), it 
follows B > 2. 

As for part (ID, if yw is the weak solution, multiplying by a regular test function 
n€C!(Q) we get 


/ vevnds + f wndx 
Q 2 


where +4 =1. Then by density we can take 1 € W!”(@) and therefore, by the 


AY 
trace theorem, nlaq € W!-@/Y.7' (a) c LY’ N-D/AW-Y9 (9), where 5’ = y'(N — 1)/ 
(N — y’), which implies that y = Ns/(N — 1). Hence, by Proposition 1 of [29], we get 
that w € W!”(Q) and Iv llwircay < CllAllzs(a@). This finishes the proof. 


< WAlleaayllnllzs' ag 


PROOF OF THEOREM 2.2. We decompose our original problem, taking g = |u|?~*u and 
h =A|u\4~7u, in such a way that u = @ + , where ¢ and w are the corresponding solu- 
tions to the linear problems (2.7) and (2.8). 

The idea to prove regularity for solutions of (2.6) is that we can iterate the estimates 
in Proposition 2.1, improving from step to step the regularity of u. The argument is as 
follows: We start assuming g € L’°(§2) and h € L®(0Q2), where 


2N 2(N — 1) 

ro = > so = -— 

(N — 2)(p — 1) (N—2)(q— J) 
In particular, if ro > N/2 (that is, p < (N + 2)/(N — 2)) we get an exponent fo > N 
such that ¢ € W!-0(92) Cc C%(2). On the other hand, if q < N/(N — 2), we get that 
w € W!%(Q) with yp > N and in this case w € C*(2). As a consequence, the C% regu- 
larity for u is proved in the case gq < N/(N — 2), p <(N+2)/(N — 2). 

If not, in any case we have proved that u € W!t% (Q) with t = min{Bo, yo} > 2. 
Then we can iterate exactly the same calculation as before, starting with g € L"! (2) and 
he L*'!(022), where 


Nt (N — 1)t 
ry = ——__—_——_ and. yj = ———____ 
(N — t)(p — 1) (N — to)(q — 1) 


If r; and s; were both large enough (namely, r; > N/2 and s; > N — 1), then we have 
finished. If not, we get that u € W!-71(92), where 


ifr; > ¥ ands; <N-1, 


min{ y~" Nor } ifri < a 
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Let us estimate these quantities in terms of the starting exponent to. Since to > 2, we 
have 


Ns1 N N 
— TO = TO. 
N-1 (N—w)(q-1) (N — 2)(q —- 1) 


And, on the other hand, it is easy to see that 


Nrj N N 
= TT > 
N-?r D(N -%|)—-N D(N-2)-—N 


TO. 


Therefore (taking into account that p and gq are subcritical) we have proved that there 
exists a constant C = C(N, p,q) > 1 such that t; > Cto, and, in general, t; > Cr. This 
implies that in a finite number of steps we reach that u € w!**(Q) with t* > N, and hence 
wEeC*(O). 

Next, we will sketch briefly the arguments in the critical case, p = 2”. In this case, the 
problem comes from the first iteration, since there is no margin to improve directly the 
initial exponent, getting W'-(Q) regularity for some Bo > 2. To overcome this difficulty 
we can use a truncation argument by Trudinger (see [120]) which proves that ||u||z7(@) < 
C(|2], |luell ,*qy), Where t > p*. The sketch of the argument is as follows: consider the 
problem 


—Au+u= Aul? ~2u in Q, 
ou — |y|4-7u on 02, 


where q is subcritical. Assume that u € H!(@), u > 0, is a solution and let us prove that 
u € L*() for some t > 2*. The main idea is to choose a suitable truncation of u? as 
test function with 6 greater but close to one. After some manipulations, that in our case 
involve the Sobolev trace inequality to handle the integrals over the boundary that appear, 
we arrive to u € LP?"(Q). As B is greater than one this estimate gives the required starting 
point, after which the argument follows as in the previous case, getting finally u € C%(Q). 

The case g = 2, with p subcritical can be handled in a similar way. With the argument 
given by Trudinger [120], we can begin the iterative procedure and also in this case we get 
we COQ). 


From the results of Cherrier [29], we have that weak positive solutions of (2.6) 
are C (0), See also [4], [84] and [119] for regularity results. Also one can extend the 
C%(Q)-regularity of the solutions using arguments based in [114] for more general elliptic 
problems like 


—div(a(x)Vv) +v=hA ing, 
a(x) =g on a&2. 


See [14] for the details. 
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3. Existence results for an elliptic problem with nonlinear boundary conditions. 
A variational approach 


To begin the study of existence of solutions to problems with nonlinear boundary condi- 
tions let us see how the usual variational techniques can be adapted. 

First, we follow the ideas from J. Fernandez Bonder and the author, see [71]. We study 
the existence of nontrivial solutions for the following problem 


Apu =|ul?-*u in Q, 
. au (3.1) 
|Vul|?--* = fu) onde. 
As we explained in the Introduction (see also Section 2), problems of the form (3.1) 
appears in a natural way when one considers the Sobolev trace inequality 


P(N — 1) 
SP llulleaaa) < lellwir@, 1S 4 < Ps =——. 
N-p 
In fact, the extremals (if there exists) are solutions of (3.1) for f(u) = Aul?-2u. 
For weak solutions of (3.1) we understand critical points of the associated energy func- 
tional 


Fuy=- [ IVul? + ura — f F (u) do, (3.2) 
PJQ a2 


where F’(u) = f(u). 

We fix 1 < p < N and look for conditions on the nonlinear term f(u) that provide 
us with the existence of nontrivial solutions of (3.1). This functional F is well defined 
and C! in W!P(Q) if f has a critical or subcritical growth, namely | f (u)| < CU + |u|2) 
with 1 <q < px = p(N — 1)/(N — p). Moreover, in the subcritical case 1 <q < p’, 
the immersion W!:? (QQ) <> L4(9Q2) is compact while in the critical case g = px is only 
continuous, see Section 2. 

First, we deal with a superlinear and subcritical nonlinearity. For simplicity we will 
consider 


f(u) =Alultu, (3.3) 


where q verifies 1 < g < px = p(N — 1)/(N — p). We prove the following theorems using 
standard variational arguments together with the Sobolev trace immersion that provide 
the necessary compactness. See [79] for similar results for the p-Laplacian with Dirichlet 
boundary conditions. 

We divide the presentation in three cases according to p <q, p=q and p> q. 

First, for p <q < px we have the following theorem. 


THEOREM 3.1. Let f satisfy (3.3) with p <q < px, then there exists infinitely many 
nontrivial solutions of (3.1) which are unbounded in W!P(Q). 
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Now we proceed with a sketch of the proof of Theorem 3.1. We believe that the ideas 
involved are illustrative on how to deal with nonlinear boundary conditions from a varia- 
tional point of view. 

Let us begin with the following lemma that will be helpful in order to prove the Palais— 
Smale condition for the functional (3.2). 


LEMMA 3.1. Let pe W!-P(92)'. Then there exists a unique weak solution u € W!-P(Q2) 


of 
—A put |u|? u=9¢. (3.4) 
Moreover, the operator Ap: @ +> u is continuous. 


PROOF. Let us observe that weak solutions u € W!:?(Q) of (3.4) are critical points of the 
functional 


a) == ful? + ul? dx — (0.4) 
PJQ 


where (-,-) denotes the duality paring in W!?(2). Hence, existence and uniqueness are 
a consequence of the fact that J is a weakly lower semicontinuous, strictly convex and 
bounded below functional. For the continuous dependence, let us first recall the following 
inequality (cf. [113]) 


ee a Colx—yl? if p>2, 
|x| 4 x—|y| ~ yY,X—y 2 |x—yl? (3.5) 
Cp Tle? if p<2, 


where (-, -) denotes the usual scalar product in R”. 
Now, given $1, $2 € W!P(Qy’ let us consider uj, u2 € w!P(Q) the corresponding so- 
lutions of problem (3.4). Then, for i = 1,2 we have 


i |Vuj|?-*Vuj (Vu — Vur) dx 
Q 
+f Jui]? 7; (wi — U2) — Gj (U1 — wz) dx =0. 
Q 
Hence, substracting and using inequality (3.5) we obtain, for p > 2, 


On| |Vuy — Vu2|? + |uy — u2|? dx 
Q 


< ((b1 — 2), (U1 — U2) 


— 
< loi — galway ilu = U2|lwieca): 
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Therefore, || Ap (1) — Ap ($2) ll wi.rcay < C(loi — ballwiocay) /P—. Now, for the case 
PD <2, we first observe that 


i} Vw _ uz)|? dx 
2 


\V(uy —ur)|? p/2 r (2—p)/2 
<(f = Csi)? dx (|Vui| + |Vuz2l) dx 
2 (\Vui| + |Vual) Q 


[es ual? ax 
Q 
ee p/2 (2—p)/2 
<([ et] (/ (Wl + al)? dr) 
@ (\ui| + |u2|)?-? Q 


As in the previous case, we get 


and 


lui — U2|lwi.r(a) 
(lalla) + Well were)? ? 


<Cllb1 — g2llwircay- (3.6) 


P 


Now we observe that ||; llwi.r(a) 


< |i ll wi.rcay llMill wi.e(qy- Hence, (3.6) becomes 


|Ar@v) — Apa) || wre) 


1/(p-1 1/(p—1) \2- 
<C(IP ill yr ncay + lldallyt nce)” lldt — ¢2llweecay 


and the proof is finished. 


With this lemma we can verify the Palais-Smale condition for F. 
LEMMA 3.2. The functional F satisfies the Palais-Smale condition. 
PROOF. Let (ug)e>1 C W!-P(92) be a Palais-Smale sequence, that is a sequence such that 
Flug) —>c and F’'(uz) > 0. (3.7) 
Let us first prove that (3.7) implies that (ux) is bounded. From (3.7) it follows that there 


exists a sequence €; — 0 such that |F’(uz)w| < ek ||W|l wiry for all w E€ W!-P(Q). Now 
we have 


1 1 
c+1 > Flug) — —F (ug)ug + —F' (ug)ur 
q q 


oe cee ree es 
— D ~ q Mayra) a q (Ux )UK 
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1 1 
2 (< = ~) leek lly t.0¢2) zo gq (ekllwi.rcayek 


1s eal F 1 
> (5 = 2) lal ego ~ gltallwrcay 


Hence, u; is bounded in W!:?(Q). By compactness we can assume that uz, — u weakly in 
W!-P(2) and uz — u strongly in L7(0Q2) and ae. in 092. Then, as p <q < px, it follows 
that |ug|?~uz — |u|?~2u in L?»(992) and hence in W!:?(2)’. Therefore, according to 
Lemma 3.1, uz > A p(\u|?~7u) in W!:P(2). This completes the proof. 


Now we introduce a topological tool, the genus, see [91]. 


DEFINITION 3.1. Given a Banach space X, we consider the class XX = {A C X: A is 
closed, A = —A}. Over this class we define the genus, y : ’ > NU {oo}, as 


y(A) = min{k EN: there exists g € C(A, R‘ \ {0}), g(x) = —(—x)}. 
We will use the following proposition whose proof can be found in [6]. 


PROPOSITION 3.1 ([6], Theorem 2.23). Let F: X — R verifying: 

(1) F €C!(X) and even. 

(2) F verifies the Palais—Smale condition. 

(3) There exists a constant r > 0 such that F(u) > 0in0 < |lullxy < rand F(u) >c>0 
if \lullx =r. 

(4) There exists a closed subspace Em C X of dimension m, and a compact set 
Am C Em such that F <0 on Am and 0 lies in a bounded component of En — Am 
in En. 

Let B be the unit ball in X, we define 


LS {h €C(X, X): h(O) =0,h is an odd homeomorphism and F(h(B)) = o} 
and 


Kn = {K CX: K =—K, K is compact, 
and y(K NA(AB)) >m forallh eT}. 


Then 


Cm = inf max F(u) 
KEK uEeK 


is a critical value of F, with0O <c < Cm < Cm41 < ©. Moreover, if Cm = Cm41 =-+* = 
Cm+r then y(Ke,) 21 +1 where K¢,, = {u€ X: F'(u) =0, Flu) = cm}. 


Cm 
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PROOF OF THEOREM 3.1. We need to check the hypotheses of Proposition 3.1. The fact 
that F is C! is a straightforward adaptation of the results in [110]. The Palais-Smale 
condition was already checked in Lemma 3.2. 

Let us check (3). From the Sobolev trace theorem, we obtain 


Flu) = = 


wh P(Q) = = Ittlds00) > “lal P(Q) hell 


wlp(Q) 
= ae 


where g(t) = at? _ cat As q > p, (3) follows for r =r(C, A, p,q) small. 


Finally, to verify (4), let us consider a sequence of subspaces Em C W!?(Q) of dimen- 
sion m such that Ey, C Ejm+1 and ulag 40 for u £0, u € E,,. Hence, 


min | |u|2 do > 0, 
UueBm JaQ 


where Bm = {u € Em: ||u\lwt.r(q) = 1}. Now we observe that 


tP ‘Atd 
F(tu) < Eee P(Q) — min / |u|? do <0 
P aQ 


q ucBn 


for all u € B,, and t > to. Therefore, (4) follows by taking Aj, = to Bm. 


In order to see that the sequence of critical points of F that we have found is unbounded 
in W!-P(Q), we need the following result. 


LEMMA 3.3. Let (Cm) C R be the sequence of critical values given by Theorem 3.1. Then 
lim, +00 Cm = OO. 


_ 1, 
PROOF. Let M = {u € W°?(Q) \ {0}: o lll vt.rgay < 
theorem, there exists a constant r > 0 such that 


|| u ee@aay)- By the Sobolev trace 


r<|lullfa~aa) Vee M. (3.8) 
Let us define 


bm = sup inf F(h(u)). 
her {uedBNES 4} 


It is proved in [6] that b,, < cj, hence to prove our result it is enough to show that b,, > oo. 
Now, bm+1 2 infveasnes, F(h(u)) for all h € I. We will construct h,, € I~ such that 


m—>oiucedaB 


lim inf F(hm(u)) = 
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First, let us define the following sequence dj, = inf{||u|| wi.r(qy: u € MN Ej, } and observe 
that dj», —> oo. In fact, if not, there exists a sequence u», € MM E*, such that uj, — 0 
weakly in W!:?(2) and therefore u, > 0 in L4(992), a contradiction with (3.8). Next, let 
us consider hy» (u) = R~'dnu where R > 1 is to be fixed. From hm we will construct hm 
Given u € W!P(Q) - that u|aq 40, pick 6 = B(u) such that 


la ulliy, P(Q) = IBulli cae) 


so Bu € M. If we consider g(t) = F(tu) with u|gq 40, it is easy to see that g is increasing 
in [0, B(u)] so g achieves its maximum on that interval for t = B(u). Take up € Ef, OB 
such that uo|aq 40, then for R > 1, 


Ro'dm <dn < IBuoll wi.rcay = B(uo). 


This inequality implies that, for every R > 1 and for every uo € EX, M B such that 
uglag #0, it holds F(hm(uo)) = F(R7~!dmuo) > 0. As hm(O) = 0, it follows that 
hm (El, OB) Cc {ue W!-P(2): F(u) > 0}. Therefore, hmles, satisfies the requirements 
needed in order to belong to I” so it comes natural try to extend hy, to W!?(Q) so it 
belongs to I”. Given ¢ > 0, consider Z, = aR (ee 1 B)+ €(E,  B). Let us see that 
for ¢ small, Z,; C M°. If not, there exists a sequence ¢; — O and a sequence (u;) C M 
such that uj; € Ze; In particular, u; is bounded in W!-P(92) so we can assume that 


uj —~u_ weakly in w!?(Q), 

uj>u in L4(02). 
Moreover, as uj € M it follows that u|aq 40. On the other hand, as || - || yi.(q) is weakly 
lower semicontinuous, we have that u € M and, as €; > 0,u¢€ dm R7! (ES  B), a con- 


tradiction. So we have proved that there exists ¢9 > 0 such that Z,, C M°. This fact allows 
us to define 


hm(u)=dmnR-'u if ue ES 


hm (a) = | Me 


EQUu if ue En. 


Now, if u € Em OB we have hy», (u) = equ € Zeg C M®, then 


= Xr 
F(hm (u)) = F (equ) = = leo, P(Q) lotta aay 


UGS 1 q 
Wl ile otlhyircay + (5 ap oe Ulliyt.egay — Heoullzaca 
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that is, given u € B if we decompose u = uy; + u2 with uy € Ef, and u2 € Ey, M B, we 
obtain hm(u) = hm (U1) + hm (uz) = dm Rou + equ2 € Ze C M° from where it follows 
that F(hm (u)) > 0 and hence hin el. 

Finally, we need to prove that Film (u)) > co asm — ow foru € dBN EX, but this 
follows from the facts that dj, — co, that dm < B(u) for ue BN E*, and that we can 
choose R large enough. If ue BN ES, hm(u) = dm R-u and 


(dm R~!)P (dm R7!)4 
F(tm(u)) = ae Foie Meld aca) 


ee 
= (dnk-')?(< - gin yr "wltaaan) 
L & a 
> (dn R-')? (< - 7 bw) "wltyacy) 


= (dn k-')? (2 ad <—), 
Ppa 


As gq > p we conclude that if R is large enough, then F(hm (u)) > +00. 


Now we consider the case 1 < g < p. Using the genus and that the functional F verifies 
a Palais—Smale condition, we have, 


THEOREM 3.2. Let f satisfy (3.3) with | <q < p, then there exists infinitely many non- 
trivial solutions of (3.1) which form a compact set in W!P(Q). 


The proof of Theorem 3.2 follows from a series of lemmas, the proofs will be omitted 
or sketched, see [71] for details. 


LEMMA 3.4. For every n € N there exists a constant ¢ > 0 such that 

y(F~*) Sn, 
where F° ={u € W!P(2): Flu) <c}. 
LEMMA 3.5. The functional F is bounded below and verifies the Palais—Smale condition. 

The following two propositions give us the proof of Theorem 3.2. 
PROPOSITION 3.2. Let 
= {Ac W!?(Q) \ {0}: Ais closed, A=—A, and y(A) >k}, 

where y stands for the genus. Then 


Ck= ps sup F (u) 


ZkueA 
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is a negative critical value of F and moreover, if c = ck = +++ = Ck+r, then y(K-) >r+1, 
where K, ={u€ W'?(Q): Flu) =c, F'(u) = 0}. 


PROOF. According to Lemma 3.4 for every k € N there exists ¢ > 0 such that y(F~*°) > k. 
As F is even and continuous it follows that F~° € X; therefore cy, < —e < 0. Moreover, 
by Lemma 3.5, F is bounded below so cx, > —oo. One can see that cx is in fact a critical 
value for ¥. To this end let us suppose that c = cy =--- =cy4,. AS F is even it follows 
that K, is symmetric. The Palais-Smale condition implies that K, is compact, therefore if 
y(K-) <r by the continuity property of the genus (see [110]) there exists a neighborhood 
of K., N3(K-) = {v € W!P(Q): d(v, Ke) < 4} such that V(N3(K-)) =v (Ke) <r. 

By the usual deformation argument, we get n(1, F°+®/? — Ns(K.)) C F°~*/*. On the 
other hand, by the definition of cz+,, there exists A C 4, such that A C Fete/2 hence 


n(1,A — Ns(Ke)) CFF. (3.9) 
Now by the monotonicity of the genus (see [110]), we have y(A — N3(K-)) = y(A) — 


V(N3(K,)) > k. As n(1,-) is an odd homeomorphism, it follows that (see [110]) 
y((1, A— N5(K-))) 2 y(A — N5(Ke)) 2 k. But as n(1, A — Ns(Ke)) € 2X then 


sup F(u) >c=ck, 
uen(1,A—N5(Ke) ) 


a contradiction with (3.9). 


Now we show that the critical points of F are a compact set of W!?(2). 
PROPOSITION 3.3. The set K ={u € W!P(Q2): F’(u) =0} is compact in W!-P (2). 


Proor. As F is C! it is immediate that K is closed. Let uj be asequence in K. We have 
that 


O=F'(uj)u; =|lu;\\? -2f |\u ;|4 do 
DLAI JN wi.p(2) ae J 


As | <q < p, we conclude that u ; is bounded in W!-P(92). Now we can use Palais—Smale 
condition to extract a convergent subsequence. 


In the case p = q, the equation and the boundary condition are homogeneous of the 
same degree, so we are dealing with a nonlinear eigenvalue problem. In the linear case, 
that is, for p = 2, this eigenvalue problem is known as the Steklov problem [115]. We have 
the following result whose proof can be found in [71], we do not provide the details in this 
case. 
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THEOREM 3.3. Let f satisfy (3.3) with p = q, then there exists a sequence of eigenval- 
ues A» of (3.1) such that ky» > +00 asn > +00. 


The variational eigenvalues 4; can be characterized by 


1 llu\l7 
= sup min peli ATL (3.10) 


, P 
Ak CECy ueC 1 yy1.o¢) 


where Cy = {C C W!:?(22); C is compact, symmetric and y(C) > k} and y is the genus 
(see [91] and Definition 3.1). It is shown in [73] that there exists a second eigenvalue 
for (6.4) and that it coincides with the second variational eigenvalue 42. Moreover, the 
following characterization of the second eigenvalue 42 holds 


ho= int | [Vul? + ira, 
ucAlJQ 


where A = {u € W!?(Q); lwllzo~ag) = Land |d2*| > O}, with aQ* = {x € AQ; 
u(x) > O} and 0827 defined analogously. 

Next we consider the critical growth on /. In this case the compactness of the immersion 
W!-P(Q) — L?*(8Q) fails, so in order to recover some sort of compactness, in the same 
spirit of [22], we consider a perturbation of the critical power, that is, 


f (u) = |ulPt ru + lulu = |ul[PN DIN P24 auf. (3.11) 


Here we use the concentration—compactness method introduced in [96,97] and follow ideas 
from [80]. First, we have the following theorem. 


THEOREM 3.4. Let f satisfy (3.11) with p <r < px, then there exists a constant X49 > 0 
depending on p,r, N and 82, such that if X > X0, problem (3.1) has at least a nontrivial 
solution in W':P(Q). 


To prove this existence result, since we have lost the compactness in the inclusion 
W!-P(2) — L?*(dQ2), we can no longer expect the Palais-Smale condition to hold. Any- 
way we can prove a local Palais—Smale condition that will hold for F(u) below a certain 
value of energy. 

Let uj; be a bounded sequence in W!-P(Q2) then there exists a subsequence that we still 
denote u ;, such that 


uj ~u_ weakly in w!?(Q), 
uj —>u_ strongly in L'(02),1 <r < px, 


\Vujl? du, |ujlaa|’* + dn, 


weakly-* in the sense of measures. Observe that dy is a measure supported on 022. 
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If we consider @ € C®({2), from the Sobolev trace inequality we obtain, passing to the 


limit, 
1/px 
(/ \p|P* an) si/p 
082 


1/p 
< (/ olan f Piva? ax + f Jou!” dx) ; (3.12) 
Q Q Q 


where S is the best constant in the Sobolev trace embedding theorem. From (3.12) we 
observe that, if u = 0 we get a reverse Hélder-type inequality (but it involves one integral 
over 02 and one over S2) between the two measures juz and 7. 

Now we state the following lemma due to Lions [96,97]. 


LEMMA 3.6. Let uj; be a weakly convergent sequence in W!-P(Q) with weak limit u such 
that 


|Vuj|? +d and |ujlag|’* ~dn, 


weakly-* in the sense of measures. Then there exists x,,...,x1 € 082 such that 
(1) d= |ulP* + Yo1 1j8x;,0) > 0, 
(2) du > |VulP + Yj Hj dx; Hj > 9, 
(3) (nj)?/P* < wj/S. 


Next, we use Lemma 3.6 to prove a local Palais—Smale condition. 


LEMMA 3.7. Let uj C W!-P(2) be a Palais—Smale sequence for F, with energy level c. 
Ifc< GC at ste where S is the best constant in the Sobolev trace inequality, 


then there exists a subsequence u ;, that converges strongly in W!P(Q). 


PROOF. From the fact that u; is a Palais-Smale sequence it follows that uj is bounded 
in W!-P(92) (see Lemma 3.2). By Lemma 3.6 there exists a subsequence, that we still 
denote u ;, such that 


uj—u — weakly in W'?(Q), 


ujau inL’(@Q2),1 <r < px, andae. in dQ, 


(3.13) 
l 


|Vu jl? = du > |Vul? + ¥> weds, 
k=) 
l 
P* dn =|ulao|"* + >> mdx- 
k=1 


lu jlaa 
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Let ¢ € C~(R) such that ¢ = 1 in B(xz, €), 6 =0 in B(xz, 2e)° and |Vo| < 2, where 
xx belongs to the support of dy. Consider {u jo}. Obviously this sequence is bounded 
in W!-P(Q). As F'(uj) > Oin W!-P(92)’, we obtain that (F'(uj); puj) > Oas j > ow. 
By (3.13), we obtain 


lim eee: Vu; Vou; dx 


jroo 


_[ bans f il odo — f equ | |u|?pdx. 
a2 a2 2 2 


Now, by Holder inequality and weak convergence, we obtain 


0< jim sim | f |Vuj|? Vu; Vou; dx 


(p—1)/p !/p 
< lim (/ |\Vuj Pax) (/ IVol?iujI? dx) 
TIO 2 2 
1/N (N=p)/(pN) 
<e(f voi" dr) (/, jel Pray) 
B(xz,2€)N2 B(xz,2€)N2 


(N—-p)/(PN) 
< otf u|PNIN-P) ax) 
B(xz,2€)N2 


>0 ase—0. 


Then 
im bans f iu odo — [ bau | jlPedx | = me — 1 =0. 
e>0LJaa aQ Q Q 
(3.14) 


By Lemma 3.6 we have that (nx) P/P*S < px, therefore by (3.14) we get (ng) P/P* S < Nk. 
Then, either nz = 0 or 


Nk > SPs (PsP). (3.15) 


If (3.15) does indeed occur for some ko then, from the fact that uj; is a Palais-Smale 
sequence, we obtain 


c= lim F(uj) 
Jrow 


1 
= lim F(uj) — —(F' (uj); u; 
jen - jiu) 


1 1 1 1 
> (< = ~) f |u|?* do + (< = —) smlio 
P Px/ Jaa P Px 
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1 1 
+A(—-—- |u|’ do 
P T/ Jag 


1 1 
> (- = ~) GPx! (Px—P) | (3.16) 
* 


As c < (4 — £)SPs/(Ps—P), it follows that fy. |uj|’*do > fo |u\?* do and therefore 
uj; — u in L?*(092). Now the proof finishes using the continuity of Ap. 


PROOF OF THEOREM 3.4. In view of the previous result, we seek for critical values below 
level c. For that purpose, we want to use the mountain pass lemma. Hence we have to check 
the following conditions: 

(1) There exist constants R,r > 0 such that if |u|] wi.r(q) = R, then F(u) > r. 


(2) There exists vy € W!?(Q2) such that loll wi.ecqy > R and F(vo) <r. 
Let us first check (1). By the Sobolev trace theorem, we have 


Fu) = ~|lull? — {wird “fia 
u) = —|lu anaes u|'* do — — u| do 
P WhP(2) Px Jaa r Jag 


1 1 
a P — —__ gP« Px eae r 
> Fld rnc) 55? Welling) ~ 7 Clery 


Let 


1 1 i. 
g(t) = —t? — —SP*tP* — —Cr’. 
Pp Px r 


It is easy to check that g(R) > r for some R,r > 0. 
(2) is immediate as for a fixed w € W!-?(2) with wWlag #0, we have 


lim F (tw) =—oo. 
t>oo 


Now, the candidate for critical value according to the mountain pass theorem is 


c= inf sup F(@(t)), 
EC te[0,1] ( ) 


where C = {@:[0, 1] > W!-?(Q); continuous and #(0) = 0, (1) = vo}. The problem is 
to show that c < G a ae) Shel (P*—P) in order to apply the local Palais—Smale condition. 

We fix w € W!:?(Q2) with || w || z+ (aa) = 1, and define h(t) = F (tw). We want to study 
the maximum of h. As lim;-... h(t) = —oo it follows that there exists a t, > 0 such that 
sup,.o F (tw) = h(t,). Differentiating we obtain 


-1 «wl =| 
O=NH=R lwllpiog hh Allwliir@a): (3.17) 
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from where it follows that lwllv.rcy =H? + PAllwilirq) Hence  < 

ee From (3.17), as ae + Allwllercaay — co when A — ov, we obtain that 
lim 4,=0. (3.18) 
A> 00 


On the other hand, it is easy to check that if A > id it must be F(t,w) 2 F(t,w), so 
by (3.18) we get lim,-+o F(t, w) = 0. But this identity means that there exists a constant 
Ao > O such that if A > Ag, then 


1 1 
sup F(tw) < (< oe = seo, 
120 P * 


and the proof is finished if we choose vp = fow with fo large in order to have F(tqw) <0. 


Now we prove a second result for the critical case. 
THEOREM 3.5. Let f satisfy (3.11) with 1 <r < p, then there exists a constant 4, > 0 
depending on p,r, N and 22 such that if 0 < 4 < 44, problem (3.1) has infinitely many 


nontrivial solutions in WP (Q). 


We begin, as we have done previously, proving a local Palais—Smale condition using 
Lemma 3.6. 


LEMMA 3.8. Let (uj) C W!P(2) be a Palais-Smale sequence for F,, with energy level c. 
Ifc< G _ oe aaa — KjP#/(Px—") where K depends only on p, r, N, and |0d82|, 


then there exists a subsequence (u ;,) that converges strongly in W!P(Q). 
PROOF. From the fact that uj; is a Palais-Smale sequence it follows that uj; is bounded 


in W!-P(Q) (see Lemmas 3.2 and 3.7). 
Now the proof follows exactly as in Lemma 3.7 until we get to 


1 1 1 1 
c> (<-—)/ jit do + (= — <-)sreioe) 
P Px a2 P Px 
1 1 
+A(—-—- |u|" do, 
P FY JIQ 


where u is the weak limit of u; in W!-?(Q). Applying Hilder inequality we find 


1 1 1 1 
c> (< ae ~) SP«/(Px—P) +4 (- 4: ~) ee 
P Px P Px 


1 1 
seg (eee Pa mee 7 | ene 
(- *)I | lull: (82) 
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Now, let f(x) = cyx?* — Ac2x". This function reaches its absolute minimum at x9 = 


(22zyVi—n, that is, f(x) > f(xo) = —KA?*/(P*-"), where K = K(p,q,N, |02)). 


Hence c > G - ot ee P) — K}Px/(P*—"), which contradicts our hypothesis. There- 
fore, 


Jr-ow 


lim 1ujIPedo = | |u|?* do, 
a2 a2 


and the rest of the proof is as that of Lemma 3.7. 


We observe, using the Sobolev trace theorem, that 


1 

Fu) > = Welly ogy ~ C1 ogy ~ Aer nga) =H (lleva) 
where j (x) = 4x? —c,x?* —Ac x". As j attains a local but not a global minimum (j is not 
bounded below), we have to perform some sort of truncation. To this end, let xo, x; be such 
that m < x9 < M <x, where m is the local minimum of j and M is the local maximum and 
Jj (x1) > j(m). For these values x9 and x; we can choose a smooth function t (x) such that 
T(x) = Lifx < x9, T(x) = Oif x > x; and0 < t(x) < 1. Finally, let p(@u) = T (lull wiry) 
and define the truncated functional as follows 


2 1 1 a : 
Fluy=— | |Vul? + |u|? dx — — |u|?*p(u)do — — |u|" do. 
PJQ Px JaQ r JaQ 


As above, Flu) = (ell yi.ecay)> where j(x) = at — c1xP?*t(x) — Ac2x". We observe 
that if x < x9 then j(x) = j(x) and if x > x; then j(x) = ae —heox". 


Now we state a lemma that contains the main properties of F. 


LEMMA 3.9. F is c*, if Fu) < 0 then ||ull wig) < X0 and F(v) = Fv) for every Vv 
close enough to u. Moreover, there exists i; > 0 such that, if0 <2 <, then F satisfies a 
local Palais—Smale condition for c <0. 


PROOF. We only have to check the local Palais-Smale condition. Observe that every 
Palais-Smale sequence for F with energy level c < 0 must be bounded, therefore by 
Lemma 3.8, if 4 verifies 0 < Cs 1) §P+/(Px—P) — Kj P«/(Px—") then there exists a con- 
vergent subsequence. ie 


LEMMA 3.10. For every n € N there exists ¢ > 0 such that y(FO ®) > n, where 
Fe = {u, Fuu)< <6}. 


PROOF. The proof is analogous to that of Lemma 3.4. 


PROOF OF THEOREM 3.5. The proof is analogous to that of Theorem 3.2, here we use 
Lemmas 3.8 and 3.10 instead of Lemmas 3.5 and 3.4, respectively, to work with the func- 
tional F and Lemma 3.9 to conclude on F. 
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Next, we deal with supercritical growth on f. More precisely, we study a subcritical 
perturbation of the supercritical power, that is, we consider 


fu) =Alult*u + [ul 7u, (3.19) 


with g > px >r > p. In this case, not only the compactness fails but also the func- 
tional F is not well defined in W!:? (2), so we have to perform a truncation in the nonlinear 
term A|u|?—7w following ideas from [27]. For this case we have the following theorem. 


THEOREM 3.6. Let f satisfy (3.19) with q > px > 1 > p, then there exists a constant i 
depending on p,q,r,N and Q such that if 0 < % < h2, problem (3.1) has a nontrivial 
positive solution in W':P(Q)NL®(8Q). 


PROOF OF THEOREM 3.6. Let us consider the following truncation of |u|?~7u 
h(u) = 4 ud}, O0<u<K, 


Then h verifies h(u) < K2~"u"—!. So we consider the truncated problem 


3.20 
|VulP-?74 = Ah(u) tu"! on aa, oe) 


ae in 92, 
and we look a positive nontrivial solution of (3.20) that satisfies u < K. Such a solution 
will be a nontrivial positive solution of (3.1). 

To this end, we consider the truncated functional 


1 |u|" 
Fyquy=— J |Vul? + |ulPdx -—A H(u)do — 
PJQ a2 02 


where H(u) verifies H’(u) = h(u). 

One can check that here exists a mountain pass solution u = uy for (3.20), that is, a crit- 
ical point of F; with energy level c,. One can easily check that this least energy solution u 
is positive. Moreover, the energy level c, is a decreasing function of 4, so we have that 
Fu) = cx, < co. Now, using (3.21), (3.20) and that H(u) < Th(u)u we have that 


do, (3.21) 


|u|" 


1 
o> Fw) =— f Val? + ul? dx —2 f Hw) do ~ [ — do 
PJQ a2 aa sr 


1 1 , 
>— ] |Vul?+|ulPdx——-(a h(u)udo + |u|’ do 
PJQ r a2 a2 
1 1 
= (< - *){ |Vul? + |u|? dx. 
P T/IQ 
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So, as r > p, we obtain ||U|| wi.r(q) < C = C(co, p, r). Now by the Sobolev trace inequal- 
ity, we get 


llulls(aay < S7'/P lull wi.rcay < C = C(Co, por, 8, 2). (3.22) 


Let us define 


u(x), u(x)<L 


os u(x) > L. 


Multiplying (3.20) by u? L Pu we get 


[iva vay (uphu) ax + f uP ub? dx 
2 


2 


=i) h(uuuh? do + [ wb? do. 
a2 02 


Therefore, using that h(u)u < K7~'u’ and the definition of uz, we obtain 


/ IvulPufhax + fw? PyPPax < Uy Gm r+ u'ul? do. 
7) 2 a 


9) 
Now we set wy = uur. Then, we obtain 


P 
|| we I W1P(Q) 


= |Vwz|? + |wz|? dx 
2 


<¢(f IvulrufPax + f uPprul® Pivupl? dx + f uul? ax) 
Q Q 2 


c([ valu ax + f wulf ax) 
2 2 


< C(AKI" + 1) iz uu? do. 


Therefore, by Hélder and Sobolev trace inequalities, we get 


“Th M@y SCOR +1) ful da 


(r—p)/Px p/o* 
< COKE + n(f urs do) (/ wr do) : 
02 a2 


P <s 
wok, p (aay = 
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where a* = oe < px. So by (3.22), 


well? <CAKIT + Illullyoecagyllwoll? 


LP*(a@) ~ L* (aQ) 


<c(a Glas oF 1) [wl Fe aay: 


Now if a thet (002); by the dominated conversence theorem and Fatou’s lemma, we 


get uP ‘li paaay < <CAKIT + Lue! le weay that is, 


= (B+1) 
Iu | Lox 6+) (aa) < C(AK4 i + 1) Puller 9@): 


Letk = me Iterating the last inequality we have 


ell peie* (ay S CUKt Ay [lM ll ze aay: 

Using again (3.22) we get ||u||L-~o(~ag) < CAKI + 1)°. Hence, if Ko > C, for every 
K = Ko, there exists A(K) such that if A < A(K) then ||u|| (a) < K. This result finishes 
the proof. 


Now, we give a nonexistence result for (3.1) in the half-space RY = {x1; > 0} (See also 
Section 4 for more results in RY ) that shows that existence may fail when one consid- 
ers critical or subcritical growth in an unbounded domain. This nonexistence result is a 
consequence of a Pohozaev-type identity. 


THEOREM 3.7. Let f satisfy (3.3) with q < px. Letu € WEP (RN) NC2(RN) A LI(aRN) 
be a nonnegative solution of (3.1) such that 


| Vu(x)|[x14/? >0 = as |x| > +00. 
Then u =0. 


We remark that the decay hypothesis at infinity is necessary, because for p = 2 
u(x) =e *! is a solution of (3.1) for every q. 


PROOF OF THEOREM 3.7. First, we multiply the equation by u and integrate by parts to 
obtain 


de |Vul? +u? dx -[ uf dx’ =0. (3.23) 
R 


N 
+ aRy 


Note that our decaying and integrability assumptions on wu justify all the integrations by 
parts made along this proof. 
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Now we multiply by x Vu and integrate by parts to obtain 


1 
-{ Ivar yuv(evuyds + f ut levuds' =< f xVu? dx. 
RY aRy RY 
+ 


RY P JR¥ 


Hence, further integrations by parts gives us 


N N-1 N 
(-1+-) f |Vul|? dx — ——— wtdx’ == | u? dx. 
P/ JRY q aRy P JRY 


Using (3.23) we arrive at 


N N-1 ; 2N 
1+ uf dx’ = {| -1+ — uP? dx > 0. 
P q aRy P / JRY 


+ 


Therefore, if u is not identically zero, we must have gq > px = p(N — 1)/(N — p) as we 
wanted to show. 


Vv Now we study a convex—concave problem with a nonlinear boundary condition. We 
follow [81] and refer to that paper for the proofs, see also [107]. In [108] a similar problem 
is studied. 

We study the existence of nontrivial solutions for the following problem 


—Au+tu=|ul?u ing, 


au — Jlul?-7u on 022. 


(3.24) 


The study of existence when the nonlinear term is placed in the equation, that is if one 
considers a problem of the form —Au = f(u) with Dirichlet boundary conditions, has 
received considerable attention, see, for example, [22,80] etc. 

We want to remark that we are facing two nonlinear terms in problem (3.24), one in 
the equation |u|?~*u, and one in the boundary condition |u|?~*u. Our interest now is to 
analyze the interplay between both. 

By solutions to (3.24) we understand critical points of the associated energy functional 
(defined on H!(2)) 


1 1 d 
Fw=; | IVul? + bed ~ — f iPad |u|? do. 
2 2 a2 


This functional F is well defined and C! in H!(Q) if p and q verify 


pyc ce Teper 
< = —— an < = ——.. 
Vere =, Nea BSR Saag 
We look for conditions that ensure the existence of nontrivial solutions of (3.24), focus- 
ing our attention on the existence of positive ones. We distinguish several cases. 
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Convex-—concave subcritical case. We suppose that 
l<q<2<p. (3.25) 


We want to remark that the new feature of these problems is that we are facing a convex— 
concave problem where the convex nonlinearity appears in the equation and the concave 
one at the boundary condition. Notice that if we look at the positive solutions of these 
problems as the stationary states of the corresponding evolution equation since the right- 
hand side of the equation represents a positive reaction term, and the boundary condition 
means a positive flux at the boundary, then some absorption is required to reach a nontrivial 
equilibrium. In our equation, this is the linear term +u. 
First, we assume that the exponents involved are subcritical, that is, 


2(N — 1) 2N 
1 2. = ———_ d 1 27S 
<q<2x an <p< Wo2 


Wu (3.26) 


We have the following theorems that can be proved using standard variational arguments 
together with the Sobolev trace immersion that provides the necessary compactness. 


THEOREM 3.8. Let p and q satisfy (3.25) and (3.26). Then there exists ho > 0 such that 
if 0 <A < Ag then problem (3.24) has infinitely many nontrivial solutions. 


Now we concentrate on positive solutions for (3.24). 


THEOREM 3.9. Let p and q satisfy (3.25) and (3.26). Then there exists A > 0 such that 
there exist at least two positive solutions of (3.24) for every . < A, at least one positive 
solution for } = A, and there is no positive solution of (3.24) for 4 > A. Moreover, there 
exists a constant C such that ||u||L0(@) < C for every positive solution. 


Critical case. Next we analyze the existence of solution when we have a critical exponent 
p = 2*. Here we use again the concentration-compactness method introduced in [96,97] 
and follow some ideas from [80]. In these kind of problems the concentration is a priori 
possible on the boundary. This difficulty leads us to use technical estimates that are implicit 
in [98]. 

For 2 <q < 2, (notice that in this case g means a convex term) we have the following 
theorem. 


THEOREM 3.10. Let p = 2* with 2 <q < 2x, then problem (3.24) has at least a positive 
nontrivial solution for every . > 0. 


And for 1 <q < 2, the next one. 
THEOREM 3.11. Jf p =2* with 1 <q <2, then there exists A such that problem (3.24) 


has at least two positive solutions for i < A, at least one positive solution for } = A and 
no positive solution for > A. 
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Further results. Moreover, to obtain existence of solutions we can apply the implicit 
function theorem near 49 = 0, uo = | to get existence of solutions for any p and q, but 
imposing a restriction on the domain. We have the following result. 


THEOREM 3.12. Given 1 < p < 00, let 2 be adomain such that (p —1) € ONeu(-A+ J). 
Then, for any q € (1, &), there exists 49 > 0 such that, for every  € (0, Ao), there exists 
a positive solution u),, € C® of (3.24) with u, > 1 in C® as h > 0. Here onen(—A + I) 
stands for the spectrum of —A + I with homogeneous Neumann boundary conditions. 


Finally let us state a result for the remaining case, g = 2. In this case we have a bifurca- 
tion problem from the first eigenvalue of a related problem. Let A, be the first eigenvalue 
of 


—Au+tu=0 ing, 
gu =u on 082. 
Notice that 4, is just the best constant in the Sobolev trace embedding H!(2) — L?(8) 
in the sense that A, ||u eee < lel rca): Then we have the following theorem. 
THEOREM 3.13. Let q =2 with2 < p <2*. Then there exists a positive solution of (3.24) 
if and only if0 <r <4. 


These ideas can also be applied to 
—Autu=Alult-2u in Q, 
ou | (3.27) 
ay a ule wu on 022. 
For this problem we assume that 1 < gq <2 < p, that is, p stands for the convex term, 
and q for the concave one, and p is subcritical (notice that in this case this means 
Pp <2(N —1)/(N —2)). The results presented here for (3.24) have analogous statements 
for (3.27). 

V In [52] the system 


—A pu =Alul?-2u + |ul’2u in Q, 
5/VulP-27 + a(x)|ul?-2u=0 ond 


is considered. Here 6 € {0, 1}, the function a is strictly positive and the exponents verify 
1<q<p<r< pN/(N — p). The author find the existence of two values 4; < Az such 
that two branches of nonnegative solutions exist for 4 € (0, 42) with the energy of one of 
them changing sign at A). 

¥ In [31] Chipot, Fila and Quittner studied the problem 


Au=auP? inQ, 
| (3.28) 


du _ gq 
yp =u on 022, 
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when p,q > 1,a > 0. The authors consider the existence of positive solutions, multiplicity, 
its symmetry, bifurcations (depending on the parameter a) and stability properties. They 
give a very complete picture in the one-dimensional case and extend some of the results to 
the general case, see also [32] for a more detailed study of the multidimensional case. Let 
us present the results for the one-dimensional problem. As it can be noticed the existence 
and symmetry of the solutions depend strongly on p and q. 


THEOREM 3.14. Denote by E the set of solutions and Es the symmetric solutions 
of (3.28). For N = 1 (Q = (—1,1)) we have five cases: 

(1) p> 2q —1. Then card(F) = 1, E= Es, foranya>0. 

(2) p=2q —1.Then E=9% for0<a<q and card(E) = 1, E= E,, fora>q. 

(3) q < p < 2q — 1. Then there exist 0 < ag < a, such that: E = 6 for a < ao; 
card(E) = 1, E = Es, fora = ag; card(E) = 2, E = Es, for ag <a <a); card(E) > 4, 
even, card(E;) =2 fora > ay. 

(4) p =q. Then there exists 0 < a, such that: E = % for0<a< 1/I1; card(E) = 1, 
E=E,, for 1/l<a< aj; card(E) =3, card(E;) = 1 fora > ay. 

(5) p <q. Then there exists 0 < a, such that: card(E) = 1, E = Es; forO<a<aj; 
card(E) = 3, card(E;) = 1 fora > ay. 


V In [121] and [122] Umezu studied the problem 


—Au+c(x)u=Aftu) mn, 
tgp + b(x)g(u)=0 onde. 


It is discussed there the existence and uniqueness of a branch of positive solutions. The 
main tools used here are not variational, the results are obtained via the implicit function 
theorem and ideas relying on super- and subsolutions. 

V In [36,37,103] the problem, 


—div(a(x)|Vul?~?Vu) +h)! = fa,x,u) in, 
a(x)|Vul?-? 4 + b(x)uP—! = Ag(x, u) on 8&2, 


is studied using a bifurcation approach with parameters 4 and 9. The authors consider 
the subcritical case, p <r < pN/(N — p). They also consider the case of an unbounded 
domain using appropriate weighted Sobolev spaces. 


4. Problems in RY 


In this section we consider solutions of elliptic problems with nonlinear boundary condi- 
tions in RY ; 
We have already find a nonexistence result in RY for subcritical exponents, Theorem 3.7. 
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Now, let us look for positive solutions of the problem 
—Au=au? in RY, 


_ du 
XN 


=ul — on {xy =O}. we 


Here a > 0 and p,q > 1. It is easy to see that for N = 1 solutions do not exist, also for 
N = 2 there is no positive solution of (4.1). 

When WN > 3 solutions exist for the critical exponents p = (N + 2)/(N — 2) and 
q=N/(N — 2). It was proved in [33] and [93] using the method of moving spheres 
(instead of moving planes) that in this case any positive solution has the form 


a 
WO) EP yO Oe 
where a > 0, ¥ = (%1,...,%v) € R% with %y = —a?/N—-) /(N — 2) and B = aa4/N-% / 
(N(N — 2)). 


When a = 0 positive solutions do not exist if gq < N/(N — 2), see [87]. Here the moving 
planes technique is applied with a plane parallel to the x, direction to prove that the solu- 
tion has to depend only in the xy variable and therefore is the zero solution. See also [117] 
for symmetry properties of problems with nonlinear boundary conditions in RY obtained 
via the moving planes device. 

In [30] it is proved that positive solutions do exist when p > (N + 2)/(N — 2) and 
q = N/(N — 2). Also it is proved there that solutions do not exist in any of the following 
cases: 

G) p<(N+4+2)/(N —2),¢g < N/(N — 2) with at least one strict inequality, 
(ii) p< N/(N —2), 

(ii) q< N/(N — 1). 

Moreover, explicit solutions exist when p = q > N/(N — 2) and a > 0. They have the 
form 


a 
(le = FP2)70-D" 


u(x) = 


where %y = —4(N —2p/(p — 1)) and a = (—2%y/(p — 1))'/P-). 

The proof of nonexistence in case (i) follows by an application of the moving planes 
method, in cases (ii) and (iii) it is a consequence of some blow-up results for parabolic 
problems. 

The idea of existence is as follows, consider the auxiliary nonlinear eigenvalue problem 


—Au=dAu+alul?"'u in BY, R)= {|x| < R}NRY, 


—# = |ult"u on {|x| < R, xy =O}, 


u=0 on {|x| = R, xn > O}. 


The proof comes from the use of Rabinowitz’s theorem that shows that there exists a 
branch of solutions (u®, r¥) emanating from (0,41),0 <A <A4, A, the first eigenvalue 
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of the corresponding linear problem. The fact that 1* is positive is proved by a Pohozaev 
identity and used to show that 4% — 0 as R — oo. It is the Pohozaev identity where 
p> (N+ 2)/(N — 2) and g > N/(N — 2) are needed. Then, Schauder estimates show 
that u® converges along a subsequence to a solution of (4.1) as R — oo. The proof of 
existence finishes by showing some symmetry and monotonicity results that allow us to 
conclude that the limit uv is nontrivial. 

v Escobar [53] and Beckner [18] proved the following sharp trace inequality in the 
half-space for the critical exponent, 


(/ |u|2N-D/N—-2) dg 
ary 


Bo Pved he vuledx) 
<sqcal RNa | (J. a 


+ 


yo 


This result has applications in geometry to the Yamabe problem on manifolds with bound- 
ary, see Section 5. 
¥ In [106] Park proved the following logarithmic Sobolev trace inequality 


N 
u|? In|ul|do < —In AN Vul? dx ). 
2 
aRN RY 


+ 


The result is obtained as a limit case for the best Sobolev trace inequality proved by Escobar 
in [53], see Section 5. Also bounds for the best constant in this logarithmic inequality are 
proved in [106]. 

Vv See also Section 12 and [42] for existence and symmetry results for a problem with a 
non-Lipschitz nonlinearity in the half-space. 

Vv Finally, in [24] Cabre and Sola-Morales studied existence and uniqueness of layer 
solutions for the problem, 


Au=0 in RY, 
ay (4.2) 
— #4 = fv) on {xy =O}. 
For layer solutions we mean solutions of the form u(x,,...,x,) that are monotone in- 


creasing from —1 to | in the x; variable with i 4 N. 


5. Yamabe problem on manifolds with boundary 


In this section we describe some results obtained by Escobar [56] concerning the prob- 
lem of prescribing the mean curvature of the boundary for a Riemannian manifold. See 
also [3]. This problem leads naturally to an elliptic problem with nonlinear boundary con- 
ditions. We will only present the geometrical motivation and some results, refereing to [3,5, 
53-56,60,85,86] for further references. 
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Let (Mg) be a compact Riemannian manifold with boundary, N > 3. Let g = 
u4/(N~2) g be a conformally related metric to g. Now we address the following problem: 
Given a function f on the boundary of M, can you find a conformally related metric g 
such that the scalar curvature of g is zero on M and the mean curvature of 0M with respect 
to the metric g is the function f? 

This problem is equivalent to finding a smooth positive function u defined on M such 
that 


Au — gy Ru =0 on M, ei 
du 4 N—2hy = N= fyN/N-2 on aM , 


where R is the scalar curvature of M, h is the mean curvature of 0M, and v is the outer 
normal vector with respect to the metric g. If we choose g = u*/("—-) g, the first equation 
in (5.1) says that the metric g has zero scalar curvature and the second equation says that 
the boundary has mean curvature f with respect to the metric g. 

For a function v € C!(M) we define the energy associated to our problem as 


= N-2 2 N-2 9 
ew= | (ive fe Ta aay +S [m. 


and the Sobolev quotient Q(M, 0M) by 
Q(M, 0M) = inf{ Q(v): ve c!(m), v#0on aM}, 


where 


_ E(v) 
= eee 1)/(N 2))(N 2)/(N-1)° 


The constraint set C(M) is defined as 


cim=|vec'(i yobs flv2Pa-D/n— 2a), 


We have the following proposition. 


PROPOSITION 5.1. There is a function u that realizes the minimum energy in C(M) if 


N-2 7 
(max Pe inf E(v) e (Vol(s%—1)) 1) 
ve 


The constant that appear in the right-hand side is the Sobolev constant of the ball in the 
Euclidean space. 

Now we assume the generic condition that there exists a point x9 € 0M where the eigen- 
values of the second fundamental form at x9 are not the same. That is to say that xo is a 
nonumbilic point. 
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THEOREM 5.1. Let M be an N-dimensional compact Riemannian manifold with bound- 
ary, N > 5. If M has anonumbilic point on 0M then 


QO(M, dM) < O(B(0, 1), ABO, 1)), 


where B(0, 1) is the ball in the Euclidean space. 

Let f verifies that is somewhere positive and achieves a global maximum at a nonum- 
bilic point xo where Af (xo) < C(N)||z — hg\l? (xo) (a stands for the second fundamental 
form), then problem (5.1) has a solution. 


For manifolds with positive Sobolev quotient and 0M umbilic we have the following 
theorem. 


THEOREM 5.2. Let M be an N-dimensional compact Riemannian manifold with bound- 
ary, N >3 and Q(M, 0M) > 0. Assume that M is locally conformally flat and 0M umbilic. 
Tf M is not conformally diffeomorphic to the ball and f verifies that it is somewhere posi- 
tive and achieves a global maximum at x9 € 0M with VE f (xo) =0 fork =1,...,N —2, 
then problem (5.1) has a positive smooth solution. 


Finally, we state a nonexistence result. 


THEOREM 5.3. Let B be the N-dimensional Euclidean ball. Let X be the conformal vec- 
tor field on 0B. Fora function f such that 


/ VX £0, 
0B 
problem (5.1) has no positive solution. 


See also [85] and [86] for other existence results assuming that (B(0, 1), g) is of positive 
type. 

V In [5] it is shown that when the metric g is close to the standard metric in the ball then 
there exists a positive solution of (5.1). 

¥ In [60] and [61] some a priori estimates on the solutions are given. 

Vv See [124] for existence results for general elliptic operators, may be in nondivergence 
form. 


6. Dependence of the best Sobolev trace constant on the domain 


In this section we deal with the dependence of the best Sobolev trace constant on the 
domain. 

First, we consider the family of domains given by contraction or expanding a fixed do- 
main, that is, for 4 > 0 we consider the family of domains 


Qy = UQ ={px;x €Q}. 
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The main purpose of this section is to describe the asymptotic behavior of the best 
Sobolev trace constants $(2,,, p,q) as 4 — 0+ and pp > +00. 

As we have mentioned in the preliminaries, for any | < p< N andl <q < px= 
p(N —1)/(N — p), we have that W!-? (2) — L4(4Q) and hence the following inequality 
holds 


Slee auays lie tne 


for all u € W!:?(Q). This is known as the Sobolev trace embedding theorem. The best 
constant for this embedding is the largest S such that the above inequality holds, that is, 
ites [Vul? + |u|? dx 


S(2,p,q= . 
ueW!P(Q)\ Wh? (2) Cee |u|4 do)P/4 


Moreover, if 1 <q < px the embedding is compact and as a consequence we have the 
existence of extremals, that is, functions where the infimum is attained, see [71]. These 
extremals are weak solutions of the following problem 


Apu=|ul?-u in Q, 


[VulP-? 4 = Alul?-2u on a@. 


Standard regularity theory, like the one sketched in Section 2, see also [119], and the strong 
maximum principle [123], show that any extremal u belongs to the class C ie (2Q)NC% (Q ) 
and that is strictly one signed in 2, so we can assume that u > 0 in £2. 

In [46] Flores and del Pino, performed a detailed analysis of the behavior of extremals 
and best Sobolev constants in expanding domains for p = 2 and g > 2. Their first result 
says that the best Sobolev trace constant in an expanding domain approaches the one in the 
half-space and gives an estimate of the error. 


THEOREM 6.1. There exists a constant y = y(q, N) > 0 such that the following expan- 
sion holds 


1 1 
S(U2,2,q)= s(R™, 2, q) — —y max H(x) +0(<) 
pL xEd22 iu 
as tL — +00. Here H(x) denotes the mean curvature of the boundary at x. 
The second result proved in that paper says that the extremals constitute a single bump 
at the boundary, whose shape is asymptotically that of an extremal for the half-space trace 
theorem. This bump is centered around a point of maximum mean curvature. 


THEOREM 6.2. Let y,, be a maximum point of u,. Then x4 = yy/ € 082 verifies 


A(x,) > max H(x) 
xed 
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as [£ — +00. Also, there exist constants a, B > 0 such that uy(y) < ae FlY—Yul for all 
y € U2. Besides, given a sequence [tn — © there exists a subsequence, an extremal w of 
ScR* 22; q) and a rotation Q such that 


sup |un(¥) — W(Q(Y — Yun, ))| > 0 
Yen, 2 


as k + oo. 
The main ingredient of the proof is to obtain some information on the limit problem 


Aw=w in RY ; 

oe =w?P on aRY. 
For this problem we have the existence of a least energy solution that verifies the decay 
estimate |w(x)| + |Vw(x)| < Cye~@*!. See also Section 4 for more results for problems 
with nonlinear boundary conditions in RY ‘ 

Let us go back to our general problem W!P(Q,) t> L4(02,,). Now we deal with the 
case of contractions, 4 — 0+. As we will see the behavior of the Sobolev constant and 
extremals is very different when the domain is contracted than when it is expanded. 

Let us call u,, an extremal corresponding to 2,,. Making a change of variables, we go 
back to the original domain 92. If we define v,, (x) = u,, (ux), we have that vy, € W!P(2) 
and 


(Nq—Npt+p)/q Jo HPV oyl? + |vyl? dx 
Clases |up|@ da)P/4 


S(QusP.g) = bh (6.1) 


We can assume, and we do so, that the functions u,, are normalized so that 


/ lvyl? do =1. 
02 


We remark that the quantity (6.1) is not homogeneous under dilations or contractions 
of the domain. This is a remarkable difference with the study of the Sobolev embedding 


Wy? (2) > L412). 
The first result of Fernandez Bonder and the author in [74] is the following theorem. 


THEOREM 6.3. Let 1 <q < px. Then 


im S(Qu, Ps) _ |2| 
u—0+ Na-Nptp/a — |aQp/4’ 


(6.2) 


and if we scale the extremals u,, to the original domain 2 as vy (x) = uy, (Ux), x € 2, with 
lun llza(a2) = 1, then v, is nearly constant in the sense that vy, > |8Q|—'/4 in W!P(Q). 
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Observe that the behavior of the Sobolev trace constant, strongly depends on p and q. If 
we call Bpg = (Nq — Np + p)/q then we have that, as 4p > 0+, 


0 if Byg > 0, 
S—+> {+00 if Byg <9, 
CA0 if By, =0. 


Let us remark that the influence of the geometry of the domain appears in (6.2). 
An idea of the proof of Theorem 6.3 runs as follows. Let us begin by the simple obser- 
vation that, taking vu = | as a test function in (6.1), it follows that 


|2| 
|0.2|P/4- 


S(Qu, Pg) < we NI NPT PI/4 (6.3) 


This shows that the ratio S(Q,,, p, q)/pNI-NP+P)/4 is bounded. So a natural question 
will be to determine if it converges to some value. This is answered in Theorem 6.3 that 
we prove next. 


PROOF OF THEOREM 6.3. Let uy, € Wh P(Qu) be a extremal for S(2,,, p,q) and define 
Vyu(x) = Uy (ux), we have that vy, € W!-P(92). We can assume that the functions Uj, are 
chosen so that 


i: ju, |fdo = 1. 
a2 


Equations (6.1) and (6.3) give, for uw < 1, 


22| 

P —P P P | 

< <ee 

Neu lirocay < fH [Vu + |v, dx < |aQ|P/a’ 

so there exists a function v € W!?(Q) anda sequence jz; — 0+ such that 


Uy; uv weakly in w!?(Q), 
Vu; >v in L?(Q), 


Vu; >v in L4(0Q). 


Moreover, 


2 
i. |Vupl? dx < ced bP. 
: [92°79 
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Hence Vu, — 0 in L?(&2). It follows that the limit v is a constant and must verify 
joo |v|? = 1, hence v = const = |82|~!/4 and so the full sequence v,, converges weakly 
in W!-P() to v. From our previous bounds we have 


1 
"> Baa in L?(Q) and [iveirax 0. 


Therefore, we have strong convergence, v,, > |82|~'/4 in W!-P(Q2). The proof is fin- 
ished. 


In the special case p = q, the problem, 


Apu=|ul?-*u in Q, 
oa 5 (6.4) 
|VulP-“ = =Alul?-“u on d&2, 
becomes a nonlinear eigenvalue problem. For p = 2, this eigenvalue problem is known 
as the Steklov problem [115]. In [71] it is proved, applying the Ljusternik—Schnirelman 
critical point theory on C! manifolds, that there exists a sequence of variational eigen- 
values A, 7 +00, see Section 3. It is easy to see that the first eigenvalue 4; ({2) veri- 
fies 41(§2) = S(2, p, p). So Theorem 6.3 shows a difference in the behavior of the first 
eigenvalue of (6.4) with p = q with respect to the domain with the behavior of the first 
eigenvalue of the following Dirichlet problem 


—Apu=AlulPu in Q, 
u=0 on 022, 


where it is a well-known fact that 2; increases as the domain decreases, see [79]. Recall 
from Section 3 that variational eigenvalues 4; of (6.4) are characterized by 


. leo) 
7, = Sup min 
k CEC, ueC ll iyt.rcay 


where Cy = {C C W!-P(2); C is compact, symmetric and y(C) > k} and y is the genus. 
It is shown in [72] that there exists a second eigenvalue for (6.4) and that it coincides 
with the second variational eigenvalue 42. Moreover, the following characterization of the 
second eigenvalue A2 holds 


do = int | |Vul? + wiPax|, 
ucA Q 


where A = {u € W!:P(Q); lu l|z>(aa) = 1 and |d2*| > c}, with AQT = {x € AN; 
u(x) > O} and 027 is defined analogously. Concerning the eigenvalue problem, we have 
the following result. 
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THEOREM 6.4. There exists a constant ho such that 


lim pPa!A9(2,) = Ad. 
Perri 2( i) 2, 


This constant 3 is the first nonzero eigenvalue of the following problem 


Apu=0 in 22, 
—2 du 7 =2 (6.5) 
|VulP “5 =AlulP*u on 02. 
Moreover, if we take an eigenfunction u2,, associated to d.2({2,,) and scale it to 2 as in 
Theorem 6.3, we obtain that v2, — v2 in W!-P(Q), where op is an eigenfunction of (6.5) 
associated to i3. Also, every eigenvalue i2(2y) <A(Qy) < AK(Qy) of (6.4) (variational 
or not) behaves as (2) ~ uP as w > O-+. Finally, if Lj > O and dj =(2,,,) is a 
sequence of eigenvalues such that there exists i with 


: pl, _ 
lim Mj Aj=a. 
Jr-ow - 
Let (v;) be the sequence of associated eigenfunctions rescaled as in Theorem 6.3, then 


(vj) has a convergent subsequence (v;,) and a limit v, that is, an eigenfunction of (6.5) 
with eigenvalue x. 


Observe that the first eigenvalue of (6.5) is zero with associated eigenfunction a con- 
stant. Hence, Theorem 6.3 says that the first eigenvalue and the first eigenfunction of our 
problem (6.4) converges to the ones of (6.5). Theorem 6.4 says that A({2,,) > +00 as 
jt — 0+ for the remaining eigenvalues and that problem (6.5) is a limit problem for (6.4) 
when jz —> 0+. 

Since we are dealing with the eigenvalue problem, let us prove the isolation and simplic- 
ity for the first eigenvalue of the p-Laplacian with a nonlinear boundary condition. This 
result was proved by Martinez and the author and is contained in [100]. So, let us study the 
first eigenvalue for the following problem 


Apu=|ul?u in Q, 
52 ‘ (6.6) 
|VulP--* = AlulP-“u on dQ. 
We have the following result, similar to the one known for Dirichlet boundary condi- 
tions [7]. 


THEOREM 6.5. A, is isolated and simple. 


We remark that this theorem says that the extremals of the Sobolev trace inequality are 
unique up to multiplication by a real number. In the special case of a ball, 22 = B(O, R), 
our result implies that the first eigenfunction is radial. In fact, if w;(x) is an eigenfunction 
associated to 4; and @(x) is any rotation then u;(0(x)) is also an eigenfunction, by our 
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result we have that u;(x) = u;(@(x)). We conclude that uw; must be radial. Also from our 
results it follows that any other eigenvalue has nonradial eigenfunctions as they have to 
change sign on the boundary (see Lemma 6.4). 

Now we prove Theorem 6.5. To clarify the exposition, we will divide the proof in several 
lemmas. 


LEMMA 6.1. Let u; be an eigenfunction with eigenvalue 41, then u, does not change sign 
on 82. Moreover, if uy is C!-“(Q2), it does not vanish on Q. 


PROOF. Recall that 


M= inf {/ Ivul? + wl? dx, f jul? do = 1}, (6.7) 
2 02 


ueW!P(Q) 


Hence if uw; is a minimizer, we have that |u| is also a minimizer of (6.7). By the maxi- 
mum principle (see [123]), we have that |u;| > 0 in §2. Assume that uw; is regular and that 
there exists x9 € 0S2 such that u;(xo) = 0. By the Hopf lemma (see [123]) we have that 
the normal derivative has strict sign, Sle (xo) <0, but the boundary condition imposes 


Ohi) (xo) = 0, a contradiction, that Sais that |u;| >Oin 2. The result follows. 
Now we state an auxiliary lemma, whose proof can be found in [95]. 
LEMMA 6.2. (a) Let p > 2. Then for all &,, &) € RN 
él? > lEil? + pléil?-7(E1, 2 — &1) + C(p)l&r — Sa”. 
(b) Let p <2. Then for all &, & € RN, 


|§& — &2|? 


P P p-2 = C 
[eat eal are lei ASivee ei) (PTE + eD=P” 


where C(p) is a constant depending only on p. 


LEMMA 6.3. A, is simple. Let u, v be two eigenfunctions associated with h,, then there 
exists c such that u=cv. 


PROOF. By Lemma 6.1 we can assume that uv, v are positive in §2. We perform the fol- 
lowing calculations assuming that u, v are strictly positive in 2, to obtain our result we 
can consider u + € and v + « and let ¢ — 0 at the end as in [95]. Therefore we can take 

= (uP? —v?)/uP—! and no = (v? —u?)/v?—! as test functions in the weak form of (6.6) 
satisfied by u and v, respectively. We have 


P_ yp 
[ vur2vuv(* Jax 
Q uP! 
P_wyP P_wP 
=a f \u|?-*u ce do f \ulP-7u ee ae 
aa uP-l Q ee 
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— yP 
iE |VoulP- ahs 
p= 
— yP 
=a f [v[P-2v{ = Jao fi [v|P-2y mya. 
an yP-l 


Adding both equations we get 


o=f |Vul?— 2yuy( 
uP 


and 


vP —uP 
Tax f [Vole vov( oF Jar. 


(6.8) 


Using that 
uP —yP pP-l 
V(“=*)-= Vu p2Vo+ (pV Vu, 
we obtain that the first term of (6.8) is 


uPal 
uP — 
f |Vul?— guy ( 7 )ax 


=f iwarr - pf vue yuvude + [ (p— DL Ivulras 


= IVinulPu? dx — p f v?|VInu|?—?(V Inu, V Inv) uv dx 
2 2 


+f (p —1)|VInu|?v? dx. 
2 


We also have an analogous expression for the second term of (6.8). Using both expressions 
we get that (6.8) becomes 


0 = (u? — v?)(|V Inw|? — |V Inv|?) dx 
Q 


-p| v?|V Inu|?—7(V Inu, VInv — V Inu) dx 
2 


-p| u? |V Inv|?-2(V Inv, V Inu — V Inv) dx. 
9) 
Taking &; = VInu and 2 = V Inv and using Lemma 6.2 we get, for p > 2, 


o> | C(p)|V Inu — VInv|? (u? + v?) dx. 
Q 
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Hence, 0 = |VInu — VInv|. This implies that u = kv as we wanted to prove. For p < 2 
we use the second part of Lemma 6.2 as above. 


Now we turn our attention to the proof of the isolation of the first eigenvalue. In order to 
prove this we need the following nodal result. 


LEMMA 6.4. Let w be an eigenfunction corresponding to X £1. Then w changes sign 
on 08, that is, wt |ag4 0 and w~|agq 4 0. Moreover, there exists a constant C such that 


lJaariSene. lea \Ser-*, (6.9) 
where 02Qt =92QN{w > 0}, IQ7 =IQN{w <0}, B=(N—-1)/(p— 1) ifl<p<N 
and B = 2 if p > N. Here |A| denotes the (N — 1)-dimensional measure of a subset A of 
the boundary. 

PROOF. Assume that w does not change sign in {2, then we can assume that w > 0 in 2 
using ideas similar to those of Lemma 6.1. Let uw; be a positive eigenfunction associated 


to A,. Making similar computations as the ones performed in the proof of Lemma 6.3 we 
arrive at 


(Ai — » fw ?—w?)d ac ff |VInw — Vinw|? (uy + w?) dx > 0. 
Therefore if we take kw instead of w we get that, for every k > 0, we have 
/ (ut —k?w?) do <0, 
aQ 
a contradiction if we take 


(or) (La) 


Therefore w changes sign in §2 and by the maximum principle [123], also w changes sign 
in 0{2. Let us use w~ as test function in the weak form of (6.6) satisfied by w to obtain 


/ ivurPrax+ f jw" Pax = 3. f lw |? do. 
Q 2 aan{w<0} 


Hence, 


1/ 
\|w vere <a(f ju do “laa- |, 
(2) ™ 30 


If 1 < p< N we choose a = (N — 1)/(N — p) and B = (N — 1)/(p — 1). Now, we 
use the trace theorem to get that there exists a constant C such that kom baereyey < 
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Cll Gasca: If p > N we choose a = 6 = 2 and we argue as before using that 


W!P(Q) — L??(dQ). A similar argument works for wt. 


With these lemmas we can prove the isolation of A. 


LEMMA 6.5. A, is isolated, that is, there exists a > h, such that i, is the unique eigen- 
value in [0, a]. 


PROOF. From the characterization of A, it is easy to see that A; < A for every eigenvalue A. 
Assume that A; is not isolated, then there exists a sequence Ax with Ax > Aq, AR \ Ay. Let 
w x be an eigenfunction associated to Ax, we can assume that ||w¢|| wi.p(q) = 1. Therefore 
we can extract a subsequence (that we still denote by w,;) such that wz, > u, in L? (022). 
Let us define ¢; € (W!?(2)) as 


Ose i) lwg|?-Pwyredo 

02 

and @ € (W!P(Q))' by 
ow =r | lu |? Pu udo. 

0922 


From the L?(0S2) convergence of w,; to u; we get that ¢, converges to @ in (WEP(Q))Y. 
Using the continuity of A, given by Lemma 3.1 we get that the sequence w, converge 
strongly in W!?(92). Therefore, passing to the limit in the weak form of (6.6) we get 
that uw; is an eigenfunction with eigenvalue A;. By Lemma 6.1 we can assume that u; > 0 
on 082. By Egorov’s theorem we can find a subset A; of 0{2 such that |A,| < € and 
We —> uy > 0 uniformly in 082 \ A,. This contradicts the fact that, by (6.9), we have, 


for every k, |02, | = 020 {wz < 0} > a aaa This result completes the proof. 


Now, we go back to our original problem, the asymptotic behavior of the best Sobolev 
trace constant when considered over the family £2,,. 

Let us look now to the case 44 — +00. In this case we find, as before, that the behavior 
strongly depends on p and q. We prove the following theorem. 


THEOREM 6.6. Let Byg = (¢N — pN + p)/q. It holds: 

(1) Ifl <q <p,0 <cypPrm! < S(Qyu, p,q) < copbrae!. 

(2) fp <q < px, 0< cy < S(Qy, p,q) Kc < ©. 
For the lower bound in (2) in the case p < q < Px, we have to assume that the correspond- 
ing extremals vy, rescaled such that maxg vy = 1 verify |Vuy| < Cu. Moreover, for all 
cases, we have that the corresponding extremals u,, rescaled as in Theorem 6.3 concen- 
trates at the boundary, in the sense that 


/ |u|? dx <Cy ho +0 asw—>+tooifg>p, 
Q 
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and 
i, lup|?dx <Cu-!>0 as [L > +00 if g < Pp, 
Q 


with 


i: lvylt do =1. 
a2 


As before, the behavior of the Sobolev trace constant depends on p and q. We have that, 
as [Lk > +00, 


S>0 if Bpg — 1 <0, Le, g < p, 


O0<c) <S<cg<0o if By, —120, ie. gq 2p. 


The hypothesis |Vvu,,| < Cy is a regularity assumption, see [29] and [119] for regularity 
results. As a consequence we have that the extremals do not develop a peak if 1 <q < p 
as in this case we have that 


Cl <| lvp|? do < cz 
a2 


and 


i lvylt do =1. 
02 


For p = q it is proved in [100] that the first eigenvalue A; (2,,) = S(2,,, p, p) is isolated 
and simple, see Theorem 6.5. As a consequence of this if §2 is a ball, the extremal v,, is 
radial and hence it does not develop a peak. Finally, for g > p the extremals develop peak- 
ing concentration phenomena in the sense that, for every a > 0, a?|02N {vy > a}| > 0 
as (4 > +00, with maxg v,, = 1. This is in concordance with the results of [46] where for 
p =2, q > 2 they find that the extremals concentrate, with the formation of a peak near a 
point of the boundary where the curvature maximizes. We believe that for g > p, extremals 
develop a single peak as in the case p = 2. Nevertheless that kind of analysis needs some 
fine knowledge of the limit problem in RY that is not yet available for the p-Laplacian. 

Let us give an idea of the proof of the lower bounds. In the case p = q we can obtain 
the lower bound by an approximation procedure. We replace W!:?(Q) by an increasing 
sequence of subspaces in the minimization problem. Then we prove a convergence result 
and find a uniform bound from below for the approximating problems. We believe that this 
idea can be used in other contexts. For the case g > p we use our assumption |Vu,| < Cu 
to prove a reverse Hélder inequality for the extremals on the boundary that allows us to 
reduce to the case p= q. 

Finally, for large jz, in the case p = q we can prove that every eigenvalue is bounded. 
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THEOREM 6.7. Let Aj (Qy) < A(Qy) < AK(2Qy) be an eigenvalue of (6.4) in 2, (vari- 
ational or not). Then there exists two constants, Cj, Cz > 0, independent of js such that 
0<Cy <A(Qy) < C2 < +00 for every yu large. 


Now we continue our study of the dependence of the best constant S(92, p,q) and ex- 
tremals on the domain by considering the best Sobolev constant in thin domains. Now we 
consider a different family of domains. Let N =n + k and define the family 


Qu ={(ux,y) |, y) ER, xER", ye R*}. 


Remark that for small values of j2, $2,, is a narrow domain in the x direction. 

Our first result shows that, when the domain is very narrow, the problem of looking at 
the trace of a function is equivalent, in some sense, to the problem of the immersion of the 
function in the projection of the domain over the y variables. More precisely, we define the 
projection 


P(2)={y €R* | ax € R” with (x, y) € 2} 


and consider the weighted Sobolev embedding W!P(P(2),a) > L4(P(2), B) with as- 
sociated best constant given by 


= (Vu? + |v|?)o(y) dy 
Si,p(P(2),p.q)= int 22 
vew!r(P(Q),a) — (fpcgy lt B(y) dy) ?/4 


We have the following theorem. 


THEOREM 6.8. Let 1 <q < px. Then there exist two nonnegative weights a, B € 
L®(P(@)) such that 


: S(Qu, P; q) ©@ 
lim saea—mprpyg = Sub (PCR), Psa) 
and if we scale the extremals uy, of S(82,, p,q) to the original domain 2 as vy(x, y) = 
q — ,n-l = 
Up (UX, y), (x, y) € 2, normalized as lu llraaa,) =p", then vy > v = v(y) strongly 


in W!-P(Q), where v € W'}P(P(Q), a) is an extremal for Sup (P(Q), D,q). 


We want to remark that the weights a and 6 can be determined in terms of the geometry 
of Q. In fact, a(y) = |2y| where 2, is the section at level y of 92. 

To clarify the content of the result, assume that (2 is a product, 92 = §2} x $22 where 
Q, CR" and 22 C R*. Then Qy = UQ, x 22 = (wx, y) |x € 21, y € 2}. As in Theo- 
rem 6.8, let us call u,, an extremal corresponding to 92, and define vy, (x, y) = Uy (x, y). 
We have that vy, € W!-P(Q) and 


S(Qu,P.q) _ Sq (Vad py, Vyop dl? + lol? dx dy 
prg—np+p)/4 a, x2, (Yul? dox dy + KS, 9.9, Ul? dx doy)P/4’ 
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where Vu = (Ux,,...,Ux,) and Vyu = (uy,,..., Uy, ). The normalization imposed in The- 
orem 6.8 in this case reduces to 


/ jyultdox dy + 1 f |v I? dx doy = 1. (6.10) 
021 x 22 21 xdQ22 


In this simpler case, the weight functions a, 6 are constants and can be computed explicitly, 
in fact, w(y) = |S2;| and B(y) = |dS2;|. Hence, Theorem 6.8 reads as follows. 


THEOREM 6.9. Let 1 <q < px and 2 = Qi x (22. Then 


fim 8% PD _ IAI Foy 
pw>0+ wI—nPtP)/4 —— |9Q,|P/4 
where S(22) = S1,1(Qo, P,q) is the usual Sobolev constant. Moreover, if we scale the 
extremals u, to the original domain @ as vy(x, y) = Up (Ux, y), X € 21, y € Qo, nor- 
malized by (6.10), then vy + v = v(y) strongly in W!-P(92), where v € W!P(Q>) is an 
extremal for S(22). 


Observe, that the critical exponent for the Sobolev embedding, W!P (Qo) > LI(Q2) 
valid for 1 <q < pk/(k — p), is larger than the one for the Sobolev trace embedding 
W!P(2) — L4(8Q), which holds for 1 <q < p(k +n—1)/(k+n-— p). 

Again, in the special case p = q, the problem becomes a nonlinear eigenvalue problem. 
Following [71] (see also [49]), a sequence of variational eigenvalues A; can be character- 
ized by 


3 lll yt.) 
Aj = inf max 


———— (6.11) 
CeC; ueC lle aay 


where 


Cj = {0(SI7!) CWhP(Q)| 2 SI“! > WhP(Q) \ (0} 


is continuous and odd} 


and S/—! is the unit sphere of R/. These eigenvalues differ slightly from the ones consid- 
ered in [71]. However, the same arguments used there apply proving that in fact {A ;} is an 
unbounded sequence of eigenvalues. 

When iz goes to zero, there is a limit problem which is a weighted eigenvalue problem 
on the projection P({2). Let a and B be the weights given by Theorem 6.8 and consider 
the following eigenvalue problem 


— div(a|Vv|?~2Vv) + a|v/?-20 =ABlv|?-7v_ in P(Q), 


5 (6.12) 
5 = 9 on dP(&2). 
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For problem (6.12), one can define the sequence 


x Spcqy IVul? + |ul? ody 
A ma 


ot , (6.13) 
CeC; vec ca) |u|PBdy 


where 


Cj = {8(S!“!) CW! P(P(Q)): &: SI“! > Wh? (P(Q)) \ {0} 


is continuous and odd}. 


Once again, applying the Ljusternik—Schnirelmann critical point theory one could check 
that {A ;} is an unbounded sequence of eigenvalues for (6.12). However, this fact is a direct 
consequence of our next result. 


THEOREM 6.10. Let 4; given by (6.11) in Q, and let uj, be an associated eigenfunc- 
tion normalized as in Theorem 6.8. Then 


where dj is defined by (6.13) and is an eigenvalue of (6.12). Also, along a subsequence, 
Uj,u(X, Y) = Uj, (Ux, y) converges strongly in W!-P(2) to a function vj = v;(y) which 
is an eigenfunction of (6.12) with eigenvalue 4 ;. 


Observe that the first eigenvalue 4; coincides with the best Sobolev trace con- 
stant S(Q2, p, p). Hence, for p = q and for the first eigenvalue, Theorem 6.8 and The- 
orem 6.10 coincide. 

As before, in the case (2 = §21 x §22, the limit problem has a simpler form, that is, 


8). 02)| 7 9 
—Apv+|v|? vs Fela lol? vin 29, 


oe =0 on 0922. 


However, Theorem 6.10 conserves the same statement. 

Our last result is concerned with the following fact: once the domain has been contracted 
in the x direction, we can now try to contract it in the y direction and see if the limit 
coincides with the one obtained by contracting the domain in every direction at the same 
time. Surprisingly, this is not the case. In fact, we obtain the following theorem. 


THEOREM 6.11. Let 2 = 22) x 922 and consider Qi) = {(ux, vy): (x, y) € Q}, then 


li : S(Quvs Ps) |2| 
im{ lim = : 
v>0\ p00 pu @d—nPt P)/4 y(ka—kp)/q ((AQ || Qz|)P/4 


360 J.D. Rossi 


By the previous results, Theorem 6.3, we have 


S(U2, p,q) |$2| |$2| 


pe pNa-Np+Py/a — \9QQ|P/4 zs (921 ||$2o|) 2/4” 


This shows that the double limit limi, »). (0,0) S(@u,v, P, g) does not exists. 
For a general domain {2 we have 


fit be ee = a 
v>0\ 0 pu "d—"P+P)/4 ykq—kp)/q ) pay Bay) e/a” 


To prove this fact we assume that the immersion W|P(P(Q), a) LY(P(2), B) is com- 
pact. To see in which cases this holds, see [66]. 


7. Symmetry of extremals 


The aim of this section is to study of the following problem: Given a ball of radius p, 
B(O, pe), in IR’, N > 3, decide whether or not there exists a radial extremal for the embed- 
ding 


H'(B(O, p)) > L4(dB(, p)). 


First, let us introduce our motivation. Recall that the best constant for the Sobolev trace 
embedding 


Sa lVul? + lvl? dx 


veH(Q)\ HUQ) (gg lvilfdo)?/4 * 


SO2.g= (7.1) 


As we noticed before, the best constant S({2, 2, q) is not homogeneous under dilatations. 
In fact, we have 


—2 2 2; 

: we“ |Vole + |v|e dx 

S(u2,2,q)=y? inf iF ae 
veH (2 \HU(Q) (fag lvl do)?/4 


where B = (Nq—2N +2)/q. For 1 <q <2, =2(N —1)/(N — 2), the embedding is com- 
pact, so we have existence of extremals, that is, functions where the infimum is attained. 
These extremals are weak solutions of the following problem 


Au=u in 22, 


ou =)lul?-*u on a2. 


The asymptotic behavior of S(u2, p, q) in expanding (44 — oo) and contracting domains 
(tt — 0) was studied in the previous section, see also [46] and [73]. In [46] it is proved that 
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for expanding domains and g > 2, S(u92,2,q) > SRN, 2,q). In [73], see Theorem 6.3, 
it is shown that 


_  S(U8,2,q) |2| 
lim = , 
p> 0+ pe |0.2|2/4 


As we mentioned in the previous section, the behavior of the extremals for (7.1) in 
expanding and contracting domains is also studied in [46] and [73]. For expanding do- 
mains, it is proved in [46] that the extremals develop a peak near a point where the mean 
curvature of the boundary is a maximum. For contracting domains, we have that the ex- 
tremals, when rescaled to the original domain as v(x) = u(x), x € 22, and normalized 
with ||v||72(a@) = 1, are nearly constant in the sense that lim,.9 v = |82|—'/4 in H'(Q). 

A big difference between the Sobolev trace theorem and the Sobolev embedding theorem 
arises in the behavior of extremals. Namely, if £2 is a ball, 2 = B(O, ¢), as the extremals 
do not change sign, from results of [82] the extremals for the usual Sobolev embedding, 
Hy (BO, 1)) — L4(B(O, 1)), are radial while, if g exceeds 2 and p is large, extremals 
for (7.1) are not, since they develop a peaking concentration phenomena as is described 
in [46]. 

The above discussion leads naturally to the purpose of this section: the study of the 
symmetry properties for the extremals of the Sobolev trace embedding in small balls. We 
find that the symmetry properties of the extremals depend on the size of the ball. Our first 
result describes when there exists a radial extremal. 


THEOREM 7.1. Let 2, = 2(N — 1)/(N — 2) be the critical exponent for the Sobolev 
trace immersion. Concerning symmetry properties of the extremals for the embedding 
H'(B(O, p)) > L4(dB(0, p)) there holds: 

(1) Let 1 <q <2. For every p > 0 there exists a radial extremal. 

(2) Let 2 <q <2,. There exists pg > 0 such that, for every p < po, there is a unique 
positive extremal u, normalized such that ||u(px)||L2(aB(0,1)) = 1; moreover, this 
extremal is a radial function. However, for large values of p, there is no radial 
extremal. 

(3) Let q =2,. There exists po > 0 such that, for every p < po, there is a positive radial 
extremal. 


The main ingredient of the proof of the symmetry result for small balls is the implicit 
function theorem. We remark that the moving planes technique cannot be applied to obtain 
symmetry results in this case, as the extremals for large p are not radial. 

For small balls, using the symmetry result in balls, for the critical exponent 2, = 2 x 
(N — 1)/(N — 2), we can prove existence of extremals, which turns out to be radial func- 
tions. For general domains 2, see [3], where it is proved that a extremal exists if the 
domain (bounded or not) verifies that it contains a point at the boundary with strictly pos- 
itive curvature. We remark that the existence of extremals for the critical exponent is not 
trivial, this is due to the lack of compactness. This result has to be compared with the case 
of the immersion Hy (BO, p)) > L? (B(O, e)) where it is well known that, by Pohozaev 
identity, there is no positive solution regardless the size of the ball for the critical exponent 
2* =2N/(N — 2). However, there exist solutions for topologically nontrivial domains. 
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In [92] Lami-Dozo and Torne studied the symmetry and symmetry breaking of the ex- 
tremals in a ball for general 1 < p < oo. Consider 


tes [Vu|? + |u|? dx 


1 
vewhrcanwer(ay “aq ult doyr/4 


S(BO, p), pg) = (7.2) 


As we have already mentioned for subcritical g, 1 <q < p(N — 1)/(N — p), the best 
constant is attained and we can assume that extremals are positive in B(O, 0). With the 
normalization (different from f. 9Qq ut =1) 


(p—q)/q 
S(BO, p), p. o( | uf do) =1, 
dB(0,p) 


the extremals are solutions of 


A ,u=uP—! in B(O, p), 
| F (0, p) (7.3) 


[Vul?-?74 = Aut-! on ABO, p). 


Let us call g; the eigenfunction associated with the first eigenvalue A, of the problem 


A — p-2 in B(O, ° 
| pr? =l9|? 29 (0, p) ans 


[Vo|P-22¢ = alg|P-29 on 9B(O, p). 


Recall that the first eigenvalue is isolated and simple, see Section 6 and [100], therefore 
¢ is radial. We have the following theorem. 


THEOREM 7.2. Let p >Oand 1 < p <o be fixed. 
(1) If there exists a radial minimizer of (7.2) then it is a multiple of 1. 
(2) Assume that there exists a radial minimizer for S(B(O, e), p, qo) then any minimizer 
for S(B(O, p), p,q) with q < qo is radial and a multiple of ¢. 
(3) Let 1 <q < p. Then the solution of (7.3) is unique and it is a multiple of 1. In 
particular, any extremal is a multiple of 9. 


Radial symmetry is lost when ¢ or gq is sufficiently large. Define the function 


(: (N pre) es 
p 


We have the following theorem. 


1 
Q(p) = Ap(p)P/@P-D 


THEOREM 7.3. Let 1 < p < oo be fixed. 
(1) Let p > 0. Ifq > Q(p) then there is no radial minimizer for S(B(O, e), p,q). 
(2) Let p <q < p(N-—1)/(N — p). There exists R(q) such that for any p > R(q) there 
is no radial minimizer for S(B(O, e), p,q). 
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The main ideas of the proofs of these theorems are as follows. The proof of unique- 
ness of the solution of (7.3) for 1 < q < p follows from Picone’s identity and the weak 
formulation. In fact, assume that there exist two positive solutions u and v, then 


uP 
o< | Ivul? dx — f Ivo? 2vuv( as 
B(0,p) B(0,p) uP 
uP 
--[ wrax+ [ utdo + f ve! _—__ dx 
B(,p) 3B(,p) B(,p) yee 


P 
= Uu 
-{ yi! = do 
9B(,p) uP 


= i ul do -{ vt PuP dao 
9B(0,p) aB(,p) 


= / ed ed - vi?) do. (7.5) 
dB(0,p) 


We can interchange the roles of u and v in (7.5) and finally obtain 


0< / (u? - v?) (ul? - ver) do. 
dB(0,p) 


Since g < p, the integrand is nonpositive and hence u = v on 0B(O, pe). The uniqueness 
follows from the uniqueness of the Dirichlet problem for A,u = u? < 

The function Q(p) appears when one try to prove that the extremals are not radial 
for large q. In fact, let ug denote the positive radial solution of Apug = ue! in RN 
normalized such that wo = | on 0B(O, pe). For any t € R and x € RY, denote by x’ = 
(x, —t,X2,...,xXy) and consider the function 


So,p) (Wuola") |? + ug (x!) dx 
S580.) ug (x!) do)P/4 


D(t) = 


After some calculations, see [92] for the details, we get 
&'(0) =0 
and 


A1(p) 


2") =c(1 (N —1) (q pacere9), 


Hence, when g > Q(e) we have ’’(0) < 0 and hence t = 0 is a local maximum for ®&. 
Therefore uo is not a minimizer. 
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One remarkable fact concerning the first eigenvalue 4;() of (7.4) is that it verifies the 
differential equation 


A 
M(p) =1-(p- 1)Aq(p)?/-) — (N - 1) we 


with the initial condition A; (0) = 1. The proof of this fact is as follows, see [92] for details. 
Let uo denote the positive radial solution of Ap,uo = ub a in R™ normalized such that 
uo(0) = 1. For any pe > 0 the first eigenfunction of (7.4) is given by the restriction of uo 


to B(O, e). From the boundary condition we get 


_ uo(o)y? 
ug(p)P—! 


A1(p) 
Differentiating with respect to o and using the equation verified by uo, 


(o%"|up(e)|? “up (0))’ = eX "uh '(p), 


we get the desired differential equation 


Mi (p) = 1 = (p= Dar (oyP/PY — (N — pow. 
To obtain the initial condition A;(0) = 1 we just observe that A;() > 1 as p — 0, see 
Theorem 6.3. 

The technique of spherical symmetrization, also known as foliated Schwarz symmetriza- 
tion, is well suited for the study of the symmetry properties of nonradial extremals for our 
problem. The definition of spherical symmetrization (see [90]) is as follows. Given a mea- 
surable set A C RN, the spherical symmetrization A* of A is defined as follows: For each r, 
take AM 0B(0,r) and replace it by the spherical cap of the same area and center rey. The 
union of these caps is A*. 

Let wu be an extremal and let u* denote the spherical symmetrization of u with respect to 
the north pole, ey. It is well known that, for any ball B(O, o), we have 


* 
| « lsraep eevee) <|l4llwt.r(eeo,p)) and (7.6) 


Ju" LP(9B(,p)) = N#IIL4@BO.p))- 


Hence, u* is also a minimizer. Remark that the restriction of u* to any sphere centered at 
the origin and contained in B(O, ¢) is an increasing function of the geodesic distance from 
the north pole. This fact together with the maximum principle imply that u* concentrates 
at a single point on the boundary of B(O, p). 

For the special case when p = 2, it is shown in [48] that either the inequality in (7.6) is 
strict or u and u* coincide on every sphere up to a rotation. This implies that any minimizer 
is spherically symmetric. 
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8. Behavior of the best Sobolev trace constant and extremals in domains with holes 


In this section, using results from [76], we study the best Sobolev trace constant cor- 
responding to the embedding of W!-P(92) into L7(8Q2) for functions that vanish on a 
fixed subset of §2, that we will call A. We consider subcritical exponents 1 <q < px = 
p(N — 1)/(N — p) so that the immersion W!:?(2) — L4(dQ2) is compact. To begin 
with, we consider a subset A C 2 with positive measure and define the best Sobolev trace 
constant associated with this set, that is, 


fo dVul? + |u|?) dx 
pq lal a5)? 


S,=int| W!?(Q), ulag #0and ula =o} (8.1) 


Since along this section we are interested in the dependence of this best constant on A, we 
have dropped the explicit dependence of S on (2, p,q). 

As a consequence of the compact immersion, there exist extremals for $4. An extremal 
for S,4 is a weak solution to 


—Aput|ul?7u=0 inQ\A, 
|VulP-7 34 = Alu|?-2u on AQ, (8.2) 
u=0 in A, 


where A depends on the normalization of u. For instance, if ||u||z¢(a@) = 1 then A= Sq. 
The existence of weak solutions to (8.2) when A = % has been studied in Section 6, 
see [71]. Of special importance is the case g = p in which the equation and boundary 
condition in (8.2) have the same homogeneity. In this case, (8.2) can be considered as a 
nonlinear eigenvalue problem. This nonlinear eigenvalue problem, in the case A = J, has 
been already studied in this work (Section 6), see also [71] and [100]. So we are study- 
ing a nonlinear generalization of an eigenvalue problem by adding the restriction that the 
functions involved vanish on a subset A. 

Optimal design problems are usually formulated as problems of minimization of the en- 
ergy, stored in the design under a prescribed loading. Solutions of these problems are un- 
stable to perturbations of the loading. The stable optimal design problem is formulated as 
minimization of the stored energy of the project under the most unfavorable loading. This 
most dangerous loading is one that maximizes the stored energy over the class of admissi- 
ble functions. The problem is reduced to minimization of Steklov eigenvalues. See [28]. 

In view of the above discussion, our first concern is to consider the following optimiza- 
tion problem: For a fixed 0 < a < |§2|, find a set Ao of measure a that minimizes S4 among 
all subsets A C §2 of measure a. We have that such a set exists and, in the case that (2 is 
a ball, that there exists an optimal set that is spherically symmetric in the sense of [90] 
(see Section 7 for the definition). Moreover, in the case p = 2, every optimal set is spher- 
ically symmetric. On the other hand, we also have that there does not exists a set A that 
maximizes S,4. Also, sup S4 = -+0o where the supremum is taken over all sets A of given 
measure a. We also get the continuity of S,4 with respect to the “hole” A. 

Optimization problems for eigenvalues of elliptic operators has been widely studied in 
the past, and is still an area of intensive research. In [48] the author studies an optimization 
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problem for the second Neumann eigenvalue of the Laplacian with A C 0S2. Our approach 
to the optimization problem follows closely the one in [48]. Optimal design problems have 
been widely studied not only for eigenvalue problems. 

Now we state the main results of this section. Our first result is the sequential lower 
semicontinuity of S4. 


THEOREM 8.1. Let Ay, C 92 be sets of positive measure such that 
* a oO 
XAn > XAq in L™ (2) 
where xa is the characteristic function of the set A. Then 
Say <liminf S4,, 
noo 
where Sa is given by (8.1). 


We remark that the continuity is not true in general. This semicontinuity result suggest 
that a minimizer for $4 among sets A of fixed positive Lebesgue measure exists. However, 
there is a major difficulty here because of the fact that sets of prescribed positive Lebesgue 
measure are not compact with respect to the topology of Theorem 8.1. The result concern- 
ing the existence of an optimal design for the constant S, is as follows. 


THEOREM 8.2. Given 0 <a < |§2|, let us define 


S(a):= inf Sa. 
AC@,|A|=a 


Then, there exists a set Ag C Q such that |Ao| =a and Sa, = S(a). On the other hand, 
there is no upper bound for S(a). Let 0 <a <|S2|. Then 


sup S4=oo. 
AC, |A|=a 


Next we study symmetry properties of optimal sets Ag in the special case where (2 is a 
ball. To this end, we use the definition of spherical symmetrization (see [90] and Section 7). 
We have the following result. 


THEOREM 8.3. Let 82 = B(O, 1) and0 <a < |B(O, 1)|. Then, there exists an optimal hole 
of measure a which is spherically symmetric, that is, A* = A. Moreover, when p = 2 every 
optimal hole is spherically symmetric. 


Now we state the results that allow us to consider the case of measure zero, that is, 
|A| = 0. For simplicity we will consider closed sets A. When trying to give sense to a best 
Sobolev trace constant for functions that vanish in a set of zero Lebesgue measure a dif- 


ferent approach has to be made. We consider the space Wee (2) = CS? (2 \ A), where 
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the closure is taken in W!? norm. That is, Wy? (2) stands for the set of functions of the 
Sobolev space W!+?(2) that can be approximated by smooth functions that vanish in a 


neighborhood of A. 
In this context the best Sobolev trace constant is defined as 
Jo lVul? + lul? dx 


in 
weWy? (Q)\Wy'? (2) (faq lula ds)P/4 


Sa= 


In this case this problem only makes sense if A is a set with positive p-capacity (see (8.3)). 
More precisely, we have that S4 = Sg if and only if the p-capacity of A is zero. Note 
that Sg is the usual Sobolev trace constant from W!:? (2) onto L4(92). Observe that the 
constants $4 and S, need not be the same. 

First, we study when S, is equal to the usual Sobolev trace constant, that is, when 
S.4 = Sg. For this purpose we recall the definition of p-capacity. For A C £2, define 


Cap, (A) 
= in| [ |Vp|? dx | o¢ W'?(RY)NC™(RY) and AC {o> uv}. (8.3) 
We have the following theorem. 
THEOREM 8.4. Let A C 2. Then Wy? (2) = W!P(Q) if and only if Cap p(A) = 0. 
As a corollary we obtain: 
COROLLARY 8.1. Cap,(A) = 0 ifand only if S4 = Sg. 


Next, we look for the dependence of S,4 under perturbations of A. We find that S4 is 
continuous with respect to A in the topology given by the Hausdorff distance. 


THEOREM 8.5. Let A, Ay, C 82 be closed sets such that d(Ay,, A) > 0 as n > co where 
d(An, A) is the Hausdorff distance between A, and A. Then |S4, —Sa| > 0 whenn > oo 
and if we denote by uy an extremal for S,4, normalized such that |\|Uy||L9(a@) = 1, there 
exists a subsequence Un, such that limg—+oo Un, = U, Strongly in W!P(Q), and u is an 
extremal for Sa. 


9. The Sobolev trace embedding with the critical exponent 


In this section we look at problems with the critical Sobolev trace exponent in the bound- 
ary condition. Existence result for elliptic problems with critical Sobolev exponents have 
deserved a great deal of attention since the pioneering work [22] and is an intensive area 
of research nowadays. 
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Now we describe the results of [35]. The authors study the problem 


Au+Aau=0 in BT (0, 1), 
u=0 on 0BT(0,1)N {xy > O}, (9.1) 
— 4 —yN/N-2) on ABT (0, 1) N {xy =O}. 


Here B* (0, 1) stands for the half-ball {|x| < 1, xy > O}. 
The following result parallels the one in [22] for Dirichlet boundary conditions. 


THEOREM 9.1. Let j11 be the first eigenvalue of the problem 


Ag+puo=0 in B*(O, 1), 
¢=0 on 9Bt (0,1) {xy > 0}, 
el ee) on 8B* (0,1) A {xy =0}. 


XN 


Then 
(1) if N 24 then a positive solution to problem (9.1) exists if and only if0 <A < yy; 
(2) for N = 3 there is no positive solution of (9.1) for 4 > 4, = 1? while for 17/4 < 
i. < 1? positive solutions exist. There is a value * € (0, x7/4) such that no positive solu- 
tion exists for —co <i <k*. 


Remark that, as happens for the Dirichlet problem (see [22]), N = 3 is a critical dimen- 
sion. 

The main reason to deal with the half-ball B*(0,1) is the fact that solutions are 
C*“(B+(0, 1)) and have cylindrical symmetry. For the nonexistence proof the authors use 
a sharp Pohozaev identity. For the existence part they consider the minimization problem 


12(Q) L2(Q) 
2 


L2N-D/N-2) (9B +(0, DN {xy >0}) 


| Veelle oq) — Alleell7 | 
Ay = inf ; 
uc H!(Q2),u=0 on {xy=0} t ||u|| 
and they prove that when 0 <A < pw, (N > 4) or A* <A < pr, (N = 3) there is the 
case when Aj, lies below a critical level. Hence the concentration—compactness results 
of [96,97] can be used to obtain the existence of a minimizer for A, that turns out to be a 
solution of (9.1). 

Vv In [3] it is studied another linear perturbation of the Laplace equation with a critical 
nonlinearity at the boundary, namely, 


Au =0 in 2, 
u=0 on Ip, (9.2) 
= Sy NIN) + ry on ly. 


Here we assume that the boundary of {2 splits into two parts [ip and Iv. If we denote 
by {11 the first eigenvalue of the problem Ag = 0 with ¢ = 0 on Ip and ae = od on Ty, 
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then problem (9.2) has a positive solution if and only if 0 < A < f41, no matter the dimen- 
sion. 

Hence, although (9.2) and (9.1) are linear perturbations of the same problem their be- 
havior for N = 3 is very different. 

For the existence result instead of A, they consider minimizing 


2 = 2 
IVulls 26g) MU lpacryy. 

2 2 U 
L2WN-D/I(N—2) (Py) 


B,=int| H'(2),u=0on ro}, 


[uel 


and prove that the minimum is attained if and only if 0 <A < jy. 

To explain the different behavior of problems (9.2) and (9.1) for N = 3, we observe 
that the linear perturbation taking place on an (N — 1)-dimensional manifold instead of an 
N-dimensional domain typically reduces the critical dimension by 1, which leads to the 
fact that there is no critical dimension for problem (9.2). 

¥ Concerning the symmetry properties of the extremals of the Sobolev trace constant, it 
is proved in [65] that if §2 is a ball of sufficiently small radius, then the extremals are radial 
functions, see Section 7. Also in [65] the authors use this result to prove that there exists 
a radial extremal for the immersion H!(B(0, p))=> L*«(dB(O, p)) if the radius p is small 
enough. See also [3] for other geometric conditions that leads to existence of extremals 
in the case p = 2. Concerning the existence of extremals for the Sobolev trace theorem 
with the critical exponent in a general smooth bounded domain £2, the main result of this 
section is the following theorem. 


THEOREM 9.2. Let @ be a bounded smooth domain in R™ such that 


I2| 1 
< > 
[asz|P/P- ~ K(N, p) 


(9.3) 


where K(N, p) is the trace constant for RY . Then there exists an extremal for the immer- 
sion W!:P(2) > LP*(aQ). 


The proof of Theorem 9.2 uses the same approach as in [15], properly adapted to our new 
context, see [75] for the details. The other key ingredient in the proof is the result of [20] 
where the author compute the optimal constant K (N, p). See also [94] for a similar result 
in the case p = 2. 

REMARK 9.1. Let 2 be any smooth bounded domain in R™ and let 
Qy = U2 = {wx |x € Q}, 


where ju > 0. We observe that when jz is small enough, precisely 


1 |aQ|1/?« 
< ? 
K(N, p)i/P |Q|t/P 


lL 
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then (2,, verifies the hypotheses of Theorem 9.2 and hence there is an extremal for the 
immersion W!:?(2,,) > L?*(0Q2,). 


REMARK 9.2. We observe that with the same ideas and computations, we can consider a 
problem of the form 


Apu=|ul?-*u in Q, 
[VulP-?7 4 = a(xjuP*! on aa, 
with a € L~© (a2) bounded away from zero. This corresponds to a Sobolev trace immer- 


sion with a weight a, on the boundary. In this case the condition on 2 and the weight 
function a is 


P/ Ds 1 P/Ps 
|22| (supa) < ——— ado : 
aQ K(N, p) \Jan 


REMARK 9.3. From the proof of Theorem 9.2, see [75], we obtain the existence of ex- 
tremals for every domain §2 that satisfies 


S(2, DP, Px) < (9.4) 


K(N, p) 
Condition (9.3) is the simplest geometric condition that ensures (9.4). 


Vv Now, let us look at the special case of studying the best constant for the Sobolev trace 
embedding from W!:!(92) into L'(8Q). We follow the presentation of [11], see also [104]. 

As W!:!(92) — L!(822) we have that there exists a constant S such that the following 
inequality holds, S||u||p1(9@) < Wl w1.1¢qy for all u € W!:!(Q). The best constant for this 
embedding is the largest 4 such that the above inequality holds, that is, 


S(2,1,1) =A, (2) 


= int f i+ f \Vul: wewh(a, [ i=}, (9.5) 
2 2 02 


Our main interest now is to study the dependence of the best constant 41({2) and ex- 
tremals (functions where the constant is attained) on the domain. We remark again that the 
existence of extremals is not trivial, due to the lack of compactness of the embedding. 

For | < p < N, let us consider the variational problem 


S(Q2, p, p) = Ap(&) 


int f wir + f |Vul?: we wha), f wi? =i}, (9.6) 
2 22 02 


This is the best constant for the trace map from wie (2) into L?(0@2). Due to the com- 
pactness of the embedding W!?(92) — L?(dQ), it is well known (see, for instance, [71]) 
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that problem (9.6) has a minimizer in W!-P(92). These extremals are weak solutions of the 
following problem 


Apu =|ul?-*u in Q, aa 
[VulP-?7 4 = Alu|?-2u on a2, 


where A pu = div(|Vu|? ~?Vu) is the p-Laplacian, 2 is the outer unit normal derivative 
and if we use the normalization ||u||,»(9@) = 1, one can check that A = 2p)(S2), see [100]. 
Our first result says that A; (<2) is the limit as p \, 1 of 4,(S2) and provides a bound 


for A, (2). 


THEOREM 9.3. We have limp\1Ap(2) = A1(2), that is, limp\1 S(Q, p, p) = S(2, 
1,1) and A\(Q2) < min{|2|/P(82), 1}; here P(&2) stands for the perimeter of 92. 


Therefore, it seems natural to search for an extremal for A; ({2) as the limit of extremals 
for 4»(S2) when p \ 1. Formally, if we take limit as p \ 1 in (9.7), we get 


7 D : 
Ayu =div( pe) = in Q, is 
py Y= AL(2) on a2. 


Hence we will look at Neumann problems involving the 1-Laplacian, Aj(u) = div(Du/ 
|Du|) in the context of bounded variation functions (that is a natural context for this type 
of problems). Following [8] (see also [10]) we give the following definition of solution of 
problem (9.8). 


DEFINITION 9.1. A function u € BV (S2) is said to be a solution of problem (9.8) if there 
exists z € X1(2) with ||zllo <1, t € L©(Q) with ||tI]~o < 1 and 6 € L~ (dQ) with 
| llan < 1 such that 


div(z)=t in D'(Q), (9.9) 
Tu=|u| ae.ins2 and (z,Du)=|Du| as measures, (9.10) 
[z,v]}=A,(2)0 and 6u=|ul, H~!-ae. onda. (9.11) 


We shall say that @ has the trace-property if there exists a vector field zo € L©(2, R) 
with ||Zelloo < 1 such that div(zg) € L©(Q) and [zg, v] = A1(2), HN—!-ae. on 92. 
Our main result states that for any domain that has the trace-property, the best Sobolev 
trace constant, A; ({2), is attained by a function in L!(9) whose derivatives in the sense of 
distributions are bounded measures on S2, that is, a function with bounded variation. 


THEOREM 9.4. Let Q be a bounded open set in R™ with the trace-property. Then, there 
exists a nonnegative function of bounded variation which is a minimizer of the variational 
problem (9.5) and a solution of problem (9.8). 
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We have that every bounded domain with A;({2) < 1, has the trace-property. Hence 
we have proved that, if 41(§2) < 1 then there exists an extremal. Moreover, using results 
from [104], we can find examples of domains (a ball or an annulus) such that 4; ({2) = 1 
and verify the trace-property (and therefore they have extremals). We also have that every 
planar domain with a point of curvature greater than 1/2 has A1({2) < 1. 

Now let us present some examples just to see how these definitions work. 


EXAMPLE. Let 2 = B(0, R) C RN, the ball in R centered in 0 of radius R. Then, if 
z(x) = x/N, we have div(z) = 1 in D/(Q) and [z, v] = R/N = |2|/P(Q), HN—!-ae. 
on 02. Moreover, ||Z||oo = R/N < 1 if and only if |Q|/P(2) <1. 


EXAMPLE. Let 2 = B(0, R) \ B(O,r) C R% the annulus in RY centered in 0 of radii R 
and r. Then, it is easy to see that if 


Nat 4 NAA ome ae as 
z(x) = l(R +r )-(R+r) Thales Fremenenese 


we have div(z) = 1 in D/(Q) and [z, v] = |Q|/P(Q), H’~!-ae. on 32. Moreover, 
IZlloo < Lif and only if |2|/P(@) <1. 


REMARK 9.4. Motron in [104] proves that if 82 = B(O, R) is the ball in RY centered in 0 
of radius R or §2 = Br(O) \ B, (0), the annulus in IR’ centered in 0 of radii R and r, then 


P(2) Ll 
luldo <——" f julax+ | [Vuldx vue w!(2), (9.12) 
an IQ| Ja 2 


and equality holds in (9.12) if and only if u is constant. 
From (9.12), it follows that if 2 = B(O, R) C R% or 2 = B(O, R) \ BO,r) Cc IR, then 


el ig {20 <1 
(82) P(Q) 
A (2) = es 


Moreover, if |§2|/P(Q) < 1, then u = (1/P(82))xq@ is a minimizer of the variational prob- 
lem (9.5), being the only minimizer in the case |2|/P(92) = 1, and if |92|/P(&2) > 1, the 
variational problem (9.5) does not have minimizer. 


In the following example we show that there exists bounded connected open sets (2, 
with |2|/P(&2) <1, for which Aj(2) < |Q|/P(Q). 


EXAMPLE. For 6 > 0 and0 <a < 5, let 
23,4 = B(O,1)U (BO,2+ 5) \ BO, 2)) 


U fe) eRt xR: a 457 <2, acte(*) <a}. 
x 
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[2sal w+ 0(5? +45) + 30 


P(Q3,4)  10mn+2nd5+2-—3a° 


Thus, forO <6 <landO<a< a3 we get [25 a|/P(&5,7) < 1. Now, if we take u := 
XB(0,2+8)\BO,2)° 


Joo, WPuldx + Jo, Idx 2a + 0 (8? + 46) 


A1(825,a) < = : 
eae Iya, Wuldo 8x + 25n — 2a 


Then, it is easy to see that for 5 and a small enough, we get A1(925.0) < |925,al/ 
P(Q5,.4) <1. 


In the next example we will see that even we can take (2 convex. 


EXAMPLE. Let @ be the set in R* with boundary the isosceles triangle with height k, base 
of length 2a and the two equal sides of length /. Let ¢ the angle between the height and one 
of the equal side. Then 


|2| ak ak ksint 


P(Q) atl) a2(ata/sint) 2(1+sint)’ 


Let E C & be the set with boundary the isosceles triangle with height k — r, base of 
length 2b and the two equal sides of length /. Then, if u := x¢, we have 


Jg|Duldx + fo luldx  2b+b(k—r) _ b(k+2—-r) 


Ai(2) < = : 
Mee) Tyo luldo 2 2b/sint 


2 Ne ) 
oe r). 


Hence, 41 (92) < |Q|/P(92) < Lif 


’ 


ip eaaks 2 a 
k <min|( je |. 


sin t sin t 


Now, obviously, we can find k,r and @ satisfying the above inequality, and consequently, 
we can obtain a convex, bounded open set £2 satisfying 41 (92) < |Q|/P(9&2) <1. 


EXAMPLE. For 0 <p <r and 6 > 0, let 


2p,7,5 = BO, p) U(BO,r +8) \ BO,r)) CR’. 
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We have 


[2por8| _ 8° +p? +2rd 
P(Qpo78)  22r+5+p) 


If we take u := x B(0,9) and v:= XBO,r+8)\BO,r)’ then 


P(u):= Secon |Dul + ne la ts 


Sa 2p.n5 |u| 2 


and 


J90,,3 Bult Sa,.,.5 || 5 
P(v):= = — =-. 
Sa.25,5 10 2 


Suppose that 0 < p <6 < 2. If we consider the vector field z in 2, ,,5 defined by 


oo) if (x, y) € Bp(0), 

z(x,y) = 

é : . 

[5-6 +27) sey if, y) © B-+5(0) \ B-(0), 

we have |[Zlloo < 1, div(z) = t in D'(2p,r,5), with t = 4 x4B0,p) + XBO.r+p)\BO,r) and 

[z, v] = 6/2, H!-a.e. on IO2p,r,9- Now, A1(82) < O(u) = p/2. Hence, A,(2) < 6/2. If 
5 = ~, we have 


MGS <P WLEW SOG Da eee 
SS, pPw.p P(Qyxp) 7 


Suppose that o < 1. Then, if we consider the vector field z in 2p ,;, defined by 


EY if (x,y) € BO, p), 


z(x,y) -| 
0 if (x, y)€ BO,r+p)\ BO,r), 


we have div(z) = XB, (0) in D'(Qp,r,9), and [z, v] = £ X9B(0,p)> H!-a.e. on 020 ,r,9- There- 
fore, u is a solution of the problem 


|w| 


Aiw:= div( 52 J=4 MmQp rp, 
(9.13) 


On 02p 7. 
Now, if we consider the vector field z in 2p ,,,p defined by 


if (x, y) € BO, p), 


20%, y) = | [oe —(o + 2r) th Gee if (x, y) € BO,r + 9) \ BO,r), 
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we have div(z) = XB(0,r+p)\B(O,r) in D'(Qo,r,p) and [z, vp] = £ Xa(B(O.r-+p)\BO,r))> H}-ae. 
on 082,79. Therefore, v is also a solution of the problem (9.13). Moreover, in this case 


also XQiszp is a solution of the problem (9.13). 


PROBLEM. Is Aj (2o7,9) = p/2? 


The next example shows that there are bounded connected open sets (2 for which 
A1(82) < 1 and |Q|/P(82) > 1. 


EXAMPLE. Let 2 :=]—k, O[ x ]O, k[ U {0} x ]O, d[ U JO, If x JO, d[ C R2 be. Then 


IQ| ke’ +6 
P(2) 4k+2 


>1 ifk>2+v6-—6. 
Now, if we take u := x40, 1[]0,8;, We have 


Jq\Dul + Jo lul _ 28 
fog lel 246 


Ay(2) < <1 = 0<6 <2. 


Therefore, for instance, if 6 = 1 and k = 5, we have |2|/P(@2) > 1 and 41 (22) < 1. 


In [104] it is considered the A—B program for W!:!() and L!(02), that is, to find the 
best possible constants A and B such that 


/ iuldo <a f IVuldx +B f |u| dx. 
a2 2 2 


It is proved that the best possible A is 1, and the best possible B is P(S2)/|Q|. 
V In [1,108,109] (see also [26]) it is studied a problem with critical nonlinearity both in 
the equation and in the boundary condition, namely, they look for positive solutions of 


Lith = |u| N+2)/(N—2) + f(x,u) in, 
gu — yN/N-2) + o(x, u) on dv2. 


Under adequate hypotheses on f and g the problem admits a positive solution. 


10. Dependence of the best Sobolev trace constant on the exponents 


In this section we focus our attention on the dependence of the best Sobolev trace constant 
on the involved exponents, p, q. 
For any | < p < 00, we define the Sobolev trace conjugate as 


po if p<N, 


Px = ; 
lee) if p2=N. 
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If 1 <q < px (with strict second inequality if p = N), we have the immersion 
W!P(Q) — L4(4Q) and hence the following inequality holds 


S|lullza(aa) < lll wirecay 


for all u € W!-P(Q). As before, the best constant for this embedding is the largest S such 
that the above inequality holds, that is, 


(fg [Vul? + lul? dxyl/? 


S(2,p,qy= inf (10.1) 

weW)P(Q)\Wy'? (2) (Jyq luld do)!/4 

Moreover, if 1 <q < px the embedding is compact and as a consequence we have the 

existence of extremals, that is, functions where the infimum is attained, see [71]. These 
extremals are weak solutions of the following problem 


Apu =|ul?-*u in Q, 

(10.2) 
|VulP-7 34 = Alu|?-2u on AQ. 

Using [119] and [123] we can assume that the extremals are positive, vu > 0, in 92. In 
the special case p = q, problem (10.2) becomes a nonlinear eigenvalue problem that was 
studied in [71,100]. From now on, let us call up,, an extremal corresponding to the expo- 
nents (p,q). 

The main purposes of this section are to study the possibility of a uniform bound (inde- 
pendent of (p,q)) on S(, p,q) and to study the limit behavior of the best Sobolev trace 
constants $({§2, p,q) as p — +00 and as g — +00 and look at the limit cases p = ov, 
l<q<oandN <p<o,q=o. The first result of [64] is the following. 


THEOREM 10.1. Given AC {(p,qg): 1< p<o0,1 <q < px}, a set of admissible (p,q), 
there exist constants C, and C2 independent of (p,q) € A such that 


Ci < S(2, p,q) < C2 


if and only if A verifies the following property: there is no sequence (Pn, qn) € A with 
Pn > N and qn > &. 


Notice that Theorem 10.1 says that we can obtain a uniform bound for $(2, p,q) on A 
as long as (p,q) € A Stays away from the point (NV, 00). Observe that the upper bound, 
S(2, p,q) < C2, follows easily by taking uv = 1 in (10.1) and holds even if we are close 
to (N, 00). The main difficulty arises in the proof of the lower bound. This is due to the 
fact that there exist functions in W!-" (2) that do not belong to L® (dQ). 

As we mentioned before, one of our concerns is to analyze the case p = co with 
1<q<.«, that is, the immersion w!(92) <> L4(d2). The best constant is given by 


S(2,00,q) = inf | 


| Vell (2) + lull n9(2) 
uEW!(2)\ Wy’ (2) 


lull L7(a.2) 
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From this expression it is easy to see that S(2, 00, g) = 1/|aQ\!/4 and S(92, 00, co) = 1, 
with extremal Uoo,q¢ = Uoo,oo = | in both cases (we normalize the extremals according 
to ||Uc0,q ||L~(82) = ||Ucv, coll z-°(a92) = 1). We prove that S({2, 00, 00) = 1 is the limit of 
S(Q, p,q) as p,q — o and also S(Q2, 00, g) is the limit of S(Q2, p,q) when p > o. 


THEOREM 10.2. Let S(92, p,q) be the best Sobolev trace constant and up,q be any ex- 
tremal normalized such that ||u p,q ||L%°(a2) = 1. Then 


lim_ S(2, p,q) = S(@, 00, 00) = 1 
PpPqrw 


and, for any 1 <r <oO,as p,q> oO, 


Up,g — Ucc,co = 1 weakly in w!(2), 


Up,q > Uco,co = 1 strongly in C*(2). 
Moreover, for fixed |< q<o, 


1 
lim S(Q, p,q) = S(2, 0, gq) = —— 
ae P.q) = S( q) aaa 
and, for any 1 <r <o,as p> @, 


Up.q — Uoo,g =1 weakly in W'" (2), 


Up,q > Uco,g =1_ strongly in C*(2). 


The limit g — oo with p > N fixed is more subtle since we do not know a priori which 
is the extremal for the limit case. However we find an equation for the limit extremal. 


THEOREM 10.3. Let p> N. Then 


lim S(Q, p,q) =S(2, p,o) 
qa ow 


and, up to subsequences, as q > &, 


Up,g ~Up,oo weakly in w!?(Q), 


Up,g > Up,oo Strongly in CD). 


Moreover, there exists a measure 4 € C(092)* with M({U poco = 1}) = 1 such that up oo is 
a weak solution of 


Apu=|ul?-u in 22, 


|Vu|?~? 54 = SP(Q, p, co)uX{uzt} on OQ. 
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We observe that W!4 (2) ¥ L®(dQ). Hence we expect that the best constant 
S(2, p,q) goes to zero as (p, g) > (N, oo). This is the content of the next result. 


THEOREM 10.4. The best constant S(92, p,q) goes to zero as (p,q) — (N, 0), and 
moreover, for any a < (N — 1)/N, there exists a constant C such that 


1 a 
S(Q,D,qy< Cmax|(P— Nya, -| : 
q 


11. Elliptic systems with nonlinear boundary conditions 


In this section we study existence and multiplicity results for elliptic systems coupled 
through nonlinear boundary conditions. We divide our exposition according to dealing 
with systems with or without variational structure. 

Existence results for nonlinear elliptic systems have deserved a great deal of interest in 
recent years, in particular, when the nonlinear term appears as a source in the equation, 
complemented with Dirichlet boundary conditions. Problems without variational structure 
can be treated via fixed point arguments. There are two main classes of systems that can be 
treated variationally, Hamiltonian and gradient systems. The system is called Hamiltonian 
if there exists a function H such that the coupling nonlinearities verify H, = f and H, = g, 
and is called gradient if there exists F with VF = (f, g). For these type of results see the 
survey [44]. 


Nonvariational systems. First, we address the existence problem without any variational 
assumption on f and g. We study the existence via topological methods of nonnegative 
solutions of the following elliptic system, 


as in Q, (1.1) 
Av=v, 
with nonlinear coupling at the boundary given by 
du 
“= f(x,u,v) ond, 
a (11.2) 
ay = 8X, u,v). 


Here f,g:092 x R» x Ry — Ry are smooth positive functions with f(x,0,0) = 
g(x, 0,0) = 0. Moreover, we deal with the “superlinear” case (see detailed assumptions 
(H1)-(H3) on f and g). 

The topological method (a fixed point argument) we apply here has been used by several 
authors to deal with problems without variational structure and, as in our case, they were 
forced to impose some growth restrictions on f and g. 
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The proofs need some knowledge on the following eigenvalue problem that was our 
main subject of study in previous sections, 


Ag=9o inf, 
|e =x, on dQ. On) 

av 

The main difficulty in carrying out the fixed point argument is to obtain L™ a priori 
bounds for (11.1)-(11.2). This difficulty is overcome by means of the blow-up technique 
introduced by Gidas and Spruck [83]. The key ingredient to make this technique work is a 
Liouville-type theorem for the system 


= DN 
ae in RY, (11.4) 
Av=0, 
with boundary conditions 
ou — yP aRN 
v on ; 
| ‘ (11.5) 
av =ul!, 
In [87], see also Section 4, the author studies the single equation 
Au=0 inRY, as 
i =uP on aRy . 


There he proves that if 1 < p < N/(N — 2) there is no nontrivial nonnegative classical 
solution of (11.6). In [88] such nonexistence-type result is applied to compute the blow-up 
rate of a parabolic problem. 

One can adapt the moving plane technique to deal with the system (11.4)-(11.5) and 
obtain the same type of result with similar restrictions on the exponents (see Theorems 
3.5 and 3.6). 

We remark that we can also deal with the semilinear case, 


—Autu=r(x,u,v) inf, 
—Av+v=s(x,u,v), 


dv 


4 — f(x, u,v) on 022, 
5p = B(x, U, v), 


using the same ideas. Since the main novelty here comes from the boundary terms, we 
present our results for (11.1)-(11.2). 

Let us give an idea of the arguments, see [70] for details. We want to apply the following 
fixed point theorem that can be found, for instance, in [43]. 


THEOREM 11.1. Let C beacone ina Banach space X and S:C — C acompact mapping 
such that S(O) = 0. Assume that there are real numbers 0 <r < Rand t > 0 such that 
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(1) x AtSx forO<t<landx €C, ||x|| =r, and 
(2) there exists a compact mapping H: Br x (0,00) > C (where By = {x €C; 
\|x || < e}) such that 
(a) H(x,0) = S(x) for ||x|| = R, 
(b) H(x,t) 4x for ||x|| = R andt > 0, 
(c) H(x,t) =x has no solution x € Br fort >to. 
Then S has a fixed point in U = {x € C;r < ||x|| < R}. 


To apply this theorem, we proceed as follows. Consider the space 
X= {(u, v): u,ve C(2)} 


with the norm || (uw, v)|| = ||ulloo + ||v|loo, which makes it a Banach space. Let $:X > X 
be the solution operator defined by S(¢, w) = (u, v), where (u, v) is the solution of 


Au=u in 22, 
e =fO.¢.H) nag, 
Av=v in 22, 
caer on 022. 


We observe that a fixed point of S is a solution of (11.1)—(11.2). 

Now, let us see that S verifies the hypothesis of the Theorem 11.1. By standard reg- 
ularity theory [84], it follows that wu and v are C®, hence S is a compact operator. As 
f(x, 0,0) = g(x, 0,0) = 0 we have, by Hopf lemma, that 5(0) = 0. Let C be the cone 
C = {(u, v) € X;u > 0, v SO}. It follows from the maximum principle that $(C) CC. 

To verify (1) in Theorem 11.1 we argue by contradiction. Let us assume that, for every 
r > 0, there exists a0 <t < 1 anda pair (U, V) such that 


AU=U_ in 
ee edad (11.7) 


AV=V, 
with 

SY =tf(x,U,V) on dQ, 

oy =tg(x,U,V). 


We multiply the first equation of (11.7) by 1, the first eigenfunction of (11.3), and we 
obtain 


o= | (AU — U) gy dx 
2 


r) 
= U(ag —eax+t | f(x, U, Verde — | ee de 
Q a2 aQ Ov 
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Hence 
o=r | Fer. U, Voids — aa f Ug) do. 
a2 a2 


We assume that f and g are “superlinear’, in fact, we make the following hypothesis that 
we call (H1), 


f@,U,V)<e(U+V) and 
(H1) 
g(x,U,V)<e(U+V)_ for small |(U, V)|. 


Using (H1) we obtain 


ia f Ug, do <et | (U+ V)g do. 
02 02 


Analogously, for V we get 


ia f Vo\do < at | (U + V)g\ do. 
aa aa 


Adding both inequalities we conclude 4; < 2e, a contradiction if ¢ verifies e < 4, /2. 
To see (2) we define H by H((¢, W), t) = S(O +t, w +14). Clearly (a) holds. To see (c) 
we have to impose any of the following conditions, we call this (H2): 
(H2.i) There exists real numbers pz > A; and C > 0 such that 


f(x,u,v) >pmu-—C 


uniformly in x € Q andv€ Ry. 
(H2.ii) There exists real numbers jz > A, and C > 0 such that 


g(x,u,v) >pvu—C 


uniformly in x € 2 andu€ R4. 
(H2.iii) There exists real numbers jz > A, and C > 0 such that 


f(x, u,v) + g(x,u,v) >pu(u+vu)—C 


uniformly in x € 2. 
For instance, assume that (H2.i) holds. Then, for ¢ large enough, we have 


f(xuttvt) > nut —C> pu 
with jz > A, and hence, for ¢ large, u is a nonnegative solution of 


Au=u inf, 
a > wu on 022, 
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which contradicts the fact that 41 is the first eigenvalue. 
The other cases can be handled in a similar way. 
Finally, condition (b) is an immediate consequence of an a priori bound for the system 


Au=u in 2, 
oa (11.8) 
with 
bu — F(x,ut+t,v +t) on 082, (11.9) 
# = g(x,u+t,v+t). | 


Hence we have proved our existence result, provided we have an a priori L® bound for 
(11.8)-(11.9). 


THEOREM 11.2. Let f and g satisfy (H1)-(H2). If there exists a constant C such that 
for every solution (u,v) of (11.1)-(11.2) it holds ||ulloo, ||Vlloo < C then the system 
(11.1)-(11.2) has a nontrivial positive solution. 


Now our aim is to prove that, under further conditions on f and g, the nonnegative 
solutions of (11.1)-(11.2) are bounded in L®, so Theorem 11.2 applies. To do so, we apply 
the blow-up technique introduced by Gidas and Spruck [83]. We argue by contradiction. 
Assume that there is no such a priori bound. Then, there exists a sequence of positive 
solutions (Uy, Vn) with max{||Un|loo, ||Un|loo} > co. Let 61, B2 be two positive numbers 
to be fixed. We can assume that ||uy||o. — oo and Wun 2 > Ilvn |. As Q is compact 
and uy, is continuous, we can choose x, € 2 such that Un (Xn) = Max gy Un. Moreover, it 
follows from the maximum principle that x, € 9. Again, by the compactness of 2, we 
can assume that x, — xo € 082. We define y, such that yp lun lloo = 1. This sequence, 
Yn, goes to 0 as n > oo. Let 


Wily) = VP un (Yay + Xn), 
wy) = VP Up (ny + Xn). 
These functions are defined in (2, = {y € RY; Yny + Xn € 92}. We observe that 0 < wy, 


Zn < land w,(0) = 1. 
On f and g we impose the following condition (hypothesis (H3)) 


f(x, u,v) =a(x)uP! + b(x)vP?? + hy (x, u,v), 
(H3) 
g(x, u,v) =c(x)uP?! + d(x)vP” + ho(x, u,v), 


where 0 <k <a,b,c,d < K <o and h; are lower-order terms 


[hi (x, Uu, v)| < ci(1 + ful% + [v|%?). 
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Here the exponents @;; satisfy 0 < aj; < pij. 
Hence, wy, and Z, satisfy 


Coo in 2p, (11.10) 
AZn = WG: 
with 
Oa = ppd Pred gy apyPil + ppt Popi2p Pio 
yn hi Ya Was Yn en) ON Op, 141) 
Ben = Pett PrP 2 cay P24 aig ye Pet! gq p22 : 
Sy I aye thin aah 


Now we want to pass to the limit in (11.10)-(11.11), so we need to know what happens 
with the coefficients of the leading terms. 

We distinguish two cases in terms of p;;, the weakly coupled and the strongly coupled 
case. 


1. Weakly coupled case. We say that the system is weakly coupled if there exists 61, B2 
such that 


£0 — pi) +1=0, bi +1— Bopi2 > 9, 
fo — p22) + 1=0, Bo+1—- Bi p21 > 0. 


Thus, in this case, we choose 


1 1 


pb, = ——_., po= : 
pial p2- 1 


These conditions impose 


P11 (p22 — 1) p22(Pu — 1) 
< and) pn) < —_—. 


1 < pil, p22, P12 
pul p22 —1 


2. Strongly coupled case. We say that the system is strongly coupled if there exist 61, B2 
such that 


Bi — pr) +1>0, Bi +1— Bopi2 =9, 
fod — p22) + 1>0, fo +1— Bi p21 =9. 
Thus, in this case, we choose 


Pi2t1 put 
1 = re | 2; = = a 
Pi2p21 — 1 P12p21 — 1 
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These conditions impose 


-1 -1 
P21 P12 and pu <1+ P21P12 


1 < pai, pi, uw<1+ 
sis P Pi2tl patil 


First we deal with the weakly coupled case. As wn, Zn are C® (see [84]) and f, g 
are smooth, we have that wy, Z, are uniformly bounded in C Ito Hence, by standard 
Schauder theory [84], we obtain that w,, z, are uniformly bounded in C ata Using a 
compactness argument we can assume that (wy, Zn) > (w, Z) in C2+8 x C2+8 with B <a. 
We observe that the domains §2,, approaches to RY. Therefore, passing to the limit, we 
obtain a nontrivial nonnegative bounded solution w of 


Aw =0 in RY, aay 
ee =a(xo)w?!! on aRY. ; 


As we mentioned in Section 4, Hu in [87] proved the following nonexistence theorem. 


THEOREM 11.3. The only nonnegative classical solution of (11.12) is w =0 when 
1 < pit < N/(N — 2) (pit is subcritical) if N >3 or 0 < pi, if N =2. 


Using Theorem 11.3 we get a contradiction and this proves the a priori bound in the 
weakly coupled case. In summary, we have proved the following result. 


THEOREM 11.4. Assume that the system (11.1)-(11.2) satisfy (H3) and is weakly cou- 
pled. If 1 < pii, p22 < N/(N — 2) (N 2 3) or 0 < pit, p22 (N = 2) then there exists a 
constant C such that every nonnegative solution verifies ||U||o0, ||Vlloo < C. 


Next, we deal with the strongly coupled case. Passing to the limit as in the previous case, 
we obtain a nontrivial, nonnegative solution of 


= . N 
es a Sees (11.13) 
zZ=0, 
with boundary conditions 
ow = b(xo)z?2 on RY, oy 
#2 = c(xg)w?P2!, a 


For this problem, using the moving planes technique, we have the following Liouville- 
type theorems, see [71], 


THEOREM 11.5. Suppose N > 3 and pj2, pro < N/(N — 2) but not both equal 
to N/(N —2), with pj2p2 > 1. Let (w,z) be a classical nonnegative solution of 
(11.13)-(11.14), then w=z=0. 
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For the case N = 2 we have to suppose that w or z is bounded, and we obtain the 
same conclusion with no restriction on the exponents p12, p21. More precisely, we have 
the following theorem. 


THEOREM 11.6. Let N =2 and pj2, p2 > 0. Let (w, z) be a classical nonnegative solu- 
tion of (11.13)-(11.14) with w bounded, then w =z=0. 


Again, applying Theorems 11.5 and 11.6 we get a contradiction in the strongly coupled 
case. In summary, we have proved the following theorem. 


THEOREM 11.7. Assume that the system (11.1)-(11.2) satisfies (H3) and is strongly cou- 
pled. If 1 < pi2p21 and p12, pri < N/(N — 2) but not both equal (N > 3) or 0 < pia, pri 
(N = 2), then there exists a constant C such that every nonnegative solution (u, v) verifies 
Illloos IVlloo SC. 


¥v Now we assume that the nonlinearities in the boundary conditions have some varia- 
tional structure. As we have mentioned, there are two main classes of systems that can be 
treated variationally, Hamiltonian and gradient systems. First, we deal with a Hamiltonian 
problem. As we have already seen, problems with no variational structure can be treated 
via fixed point arguments. 


Hamiltonian elliptic systems. We study the existence of nontrivial solutions of the elliptic 
system 


Au=u in. 
; 11.1 
| Av=v0, ( >) 
with nonlinear coupling at the boundary given by 
du 
S“=AHy(x,u,v) ond, 
a oe (11.16) 
ap = Ay(x, u,v). 


Here H:02 x R x R= R is a smooth positive function (say C!) with growth control 
on # and its first derivatives. 

The results obtained for this Hamiltonian problem are strongly inspired by [45]. There 
the authors study 


| —Au= Ay(x,u,v) in, 
—Av= Ay (x, U, v), 


complemented with Dirichlet boundary conditions. They prove existence of strong solu- 
tions using the same variational arguments we use here and, as in our case, they were 
forced to impose similar growth restrictions on H. 

The crucial part here is to find the proper functional setting for (11.15)-(11.16) that 
allows us to treat our problem variationally. We accomplish this by defining a self-adjoint 
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operator that takes into account the boundary conditions together with the equations and 
considering its fractional powers that verify a suitable “integration by parts” formula. Once 
we have done this, the proof follows the steps used in [45]. For the proof we use a linking 
theorem in a version of [62]. Linking theorems have been proved to be a useful tool in 
order to obtain existence result of elliptic problems. 

The precise assumptions on the Hamiltonian H are 


|H (x, u, v)| <C(lu|?*? + |vjtt! +1), (11.17) 
and for r > 0 small, if |(@u, v)| <r, 
|H(@x,u, v)| <C(lul* + |vl?), (11.18) 


where the exponents p+ 1 >a>p>Oandq+12£8>q >0 satisfy 


lA 
Li SS; (11.19) 
a £B 
1 1 1 
fas) ee ee ea ie (11.20) 
a B q+la p+l1 £6 N-1 
1 1 
ee Si, Sag at ee (11.21) 
p+l1 £6 qt+l a 
If N > 4 we have to impose the additional hypothesis 
1 1 N+1 
max{ 2: 4, q Bees Boer | < = : (11.22) 
a B q+l1 a p+lil 8 2(N — 1) 


When a = p+ 1 and 8 =q +1, conditions (11.19), (11.20) and (11.22) become 


1 1 1 N+1 


1> >1 ; a< 
beh gel N-1 pe 


< —_ ifNe4. 
N-3 


REMARK 11.1. These hypothesis, (11.19)-(11.22), imply that there exists s and t with 
s+t=1,s5,t> 1/4 such that 


w-p 1 2%w-1/2 B-q 1 2%-1/72 

a OF Wer i ae ek ie 
p@+)) 1 2-172 gp) 1 2-172 
Apt) 2. MT agi)” 2 N—1" 


On the derivatives of H we impose the following: 


< C(lul? at |y|PatD/@tD ae 1), 


0H 
— (x, Uu, v) 
Ou 

(11.23) 


0H 
Foun) <C (luis PT DMG) + Jolt + 1). 
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And for R large, if |(u, v)| > R 


nee Fo suet (x,u,v)v > A(x, u,v) > 0, (11.24) 
a B ov 


we observe that from (11.24), it follows that (see [62]) 
|H (x, u, v)| > c(|ul® + |u|?) —C. (11.25) 
We have the following theorem. 


THEOREM 11.8. Let us assume that H:d92 x R x R= R verifies (11.17)-(11.24). Then 
there exists a nontrivial solution to (11.15)-(11.16). 


Next, we look for positive solutions. If we also impose 


0H = 

ay u,v), py u,v) >0 forallu,v >0, (11.26) 
—(x,u,v)=0 whenu=0, 

Ou 


Pe (11.27) 
—(x,u,v)=0 whenv=0O, 
dv 


we can prove the following theorem. 


THEOREM 11.9. If H:02 x Rx R- R verifies (11.17)-(11.24) and (11.26)(11.27), 
then there exists at least one positive solution to (11.15)-(11.16). 


Multiplicity. Now we study the existence of infinitely many nontrivial solutions of the 
elliptic system (11.15)—(11.16). To study multiplicity of solutions we are inspired by the 
articles [17] and [63] where the authors study a Hamiltonian system with Dirichlet bound- 
ary conditions in a bounded domain. 

As before the crucial part in the nonlinear boundary conditions case, is to find the proper 
functional setting for (11.15)-(11.16) that allows us to treat our problem variationally. 
We assume the same hypotheses on the Hamiltonian H as before, but adding the following 
symmetry condition 


A(x,u,v) = A(x, —u, —v). (11.28) 
We have the following theorem. 
THEOREM 11.10. Assume that H:02 x Rx R—- R satisfies (11.17)-(11.28). Then 


there exists a sequence of nontrivial strong solutions {Un, Vy} to (A1.1)-(11.2) such that 
I|Unll w2.@+n/@ (a) + [lun Il w2.0+D/()(Q) > Ow. 
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¥ In [125] and [112] the previous results were generalized by using a new version of 
the linking theorem with the same functional setting described below. This new version of 
the linking argument may have applications to other elliptic problems. 

Now let us describe the functional setting that allows us to treat (11.15)-(11.16) varia- 
tionally. Let us consider the space L?(Q) x L*(92) which is a Hilbert space with inner 
product, that we will denote by (-, -), given by 


(u,v), @, W)) =) ud dx +f vy do. 
2 02 
Now, let A: D(A) C L?(Q) x L?(8@Q@) > L?(Q) x L?(9Q) be the operator given by 


ou 
Alu, ulag) =| —Au+u, — }, 
an 


where D(A) = {(u,ulag) | u € H?(Q)}. We claim that D(A) is dense in L?(Q) x 
L?(aQ). In fact, let (fig € C(2) x C(a@), take ¢ > 0 and consider 2, = {x € 2 | 
dist(x, 052) > e}. Now we choose u € C*(Qz) such that ||u — f || ,2(q,) is small. As 02 is 
smooth, we can extend u to the whole 2 in such a way that u € C?(Q) and ||u — g lx2(a@2) 
is also small. As ¢ is arbitrary and C(Q) x C(9Q) is dense in L?(Q) x L?(9Q2) the claim 
follows. 

We observe that A is invertible with inverse given by A~!(f, g) = (u, ulaq), where u is 
the solution of 


—Autu=f im, 
{ang on 022. 


By standard regularity theory, see [84], page 214, it follows that A~! is bounded and com- 
pact. Therefore, R(A) = L?(Q) x L?(8@2) thus in order to see that A (and hence A~!) is 
self-adjoint it remains to check that A is symmetric. To see this, let u, v € D(A), and by 
Green’s formula we have 


0 
(Au, v) -|/ (Au +uyvdx + f “ude 
Q Vv 


a 
=a u(—av+vdx+ f ede =e Avy. 
Q a v 


therefore, A is symmetric. Moreover, A (and hence A!) is positive. In fact, let uw € D(A) 
and using again Green’s formula, 


ou 
(aun) = | (Autuyuar + f ee 
2 


udo = [ |Vul? +u> dx >0. 
aa OV Q 
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Therefore, there exists a sequence of eigenvalues (A,,) C R with eigenfunctions (¢@n, Wn) € 
L?(Q) x L?(82) such that 0 < Ay <A2 < ++: S An <-+: A +00 and gd, € H?(2), 
Onlaz = Vn> 


| —Adn + on =Andn in 22, 
oon =dndn on 092. 


Let us consider the fractional powers of A, for 0 <s < 1, A*: D(A‘) > L?(2) x L*(d2), 
A® is given by 


A’u= > dan (ns Wn), 


n=1 


where u = >) an(¢n, Wn). We call E* = D(A‘). E* is a Hilbert space with inner 
product, that we denote by (-,-)zs, given by (u,@)gs = (A*u, A*d). Let us see that 
E*’ c H*5(). In fact, if we define A, : H2(2) c L?(2) = > L*(2), Aju = —Au + u, 
and Ap: H?(Q) Cc D(A) C L7(82) > L782), ae = % Then A = (Aj, A2) ver- 
ify A= Al(u.u)s u € D(A,)M D(A2), and hence A* = Bi UE D(A} yn D(A5). As 
D(A) = H2(2) C D(A), we have D(A}) C D(A3), therefore E* = D(A*) = D(A}). 
Now, by the results of [118], as 2 is smooth, it follows that E* = D(A}) C H?5(Q). So 
we have the following inclusions 


ES > H*§(2) > HH"! (a2) > L?(a@). 


More precisely, we have the following immersion theorem. 

THEOREM 11.11. Given s > 1/4 and p >1 so that 1 > 5 a ae the inclusion map 
i: E* + L?(0Q2) is well defined and bounded. Moreover, if above we have strict inequality, 
then the inclusion is compact. 


Let us now set E = E* x E' where s +t =1, s,t given by Remark 11.1 and define 
B:Ex E>R by B((u,v), (¢, W)) = (Abu, A'w) + (A%@, A’v). E is a Hilbert space 
with the usual product structure, and hence B is a bounded, bilinear, symmetric form. 


Therefore, there exists a unique bounded, self-adjoint, linear operator L: E > E, such 
that B(z, y) = (Lz, y)z. Now we define 


O(zZ) = SBC, a= sls, 2e =(A*u, A‘v). 
By (11.17), Remark 11.1 and Theorem 11.11, we can define H: E > Ras 


Au, v) =f A(x,u,v)do. 
aQ 
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PROPOSITION 11.1. The functional H defined above is of class C! and its derivative is 
given by 


Hw. y6.w= | Hy(x.u,vyodo + f Hy(x, u,v) do. (11.29) 
022 0922 


Moreover, H' is compact. 
° 


PROOF. From (11.23) we have 


0H 
i: oun 
aa| ou 


By Holder’s inequality and Theorem 11.11, we have 


i 


In a similar way we obtain the analogous inequality for Hy. 

Thus H’ is well defined and bounded in E. Next, a standard argument gives that H is 
Fréchet differentiable with H’ continuous. The fact that H’ is compact comes from Theo- 
rem 11.11 (see [110] for the details). 


do < cf (ul? - |y|PatD/@e+) or 1)|d|do. 
02 


oH 1 1 
5, Ore IG] do < C(llelles + oat) + 1) ip lies. 


Now we can define the functional F: E > Ras 
Flu,v) = Qu, v) — Alu, v). 


The functional F is of class C! and it has the structure needed in order to apply minimax 
techniques. 

To end the description of the functional setting let us now give the definition of weak 
solution of (11.15)-(11.16). 


DEFINITION 11.1. We say that z= (u,v) € E = E*® x E' is an (s, t)-weak solution of 
(11.15)-(11.16) if z is a critical point of F. In other words, for every (¢, W) € E, we have 


(atu, aly) +(4%, ata) — f Hy(x.u,v)bdo — f H,(x,u, v) do =0. 
a2 02 


With this definition it only remains to show that F has critical points using a linking 
argument [68,69,112,125]. 


Gradient elliptic systems. Now we assume that we are dealing with a gradient elliptic 
system 


Apu=l|ul?u in &, 


11.30 
Aqv= |v|¢-7v, ) 
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with nonlinear coupling at the boundary given by 


Vul?—2 24 — F X,u,v) ond, 
{ P28 = Fy (x, u,v) or 


|Vult-? 5 = Foe, u,v). 
Here (F,,, F,) is the gradient of some positive potential F :dQ x R x R— R with precise 
hypotheses that we state below. 

As before, for (weak) solutions of (11.30)-(11.31) we understand critical points of the 
functional 


|VulP |u|? |Vu|7 vl? 
Flu, v) = ——— + —dx+ + dx F(x,u,v)do. 
2 ?~P P 2 | q a2 


(11.32) 


The geometry of F is similar to the one of the functional 
1 
Fy (u) = a |Vul|? + |u|? dx -[ F(x,u)do 
PJ2Q aQ 


which corresponds to a single quasilinear equation with nonlinear boundary conditions. 
The functional F; was studied in [71] where essentially the case F(x, u) = |u|” was con- 
sider. However, some interesting phenomena appear in (11.32) due to the coupling in the 
system (11.30)-(11.31). Our results for (11.30)—(11.31) generalize the ones in [71] both to 
systems and to more general potentials. In [17] the functional 


Fw.v)= | IVul? + Voltas — f F(x, u, v) dx 
2 2 


was analyzed. In this paper we extend their results to the nonlinear boundary condition 
case and moreover some new results are obtained. For instance, multiplicity results in the 
subcritical case with an oddness condition on F and mainly, existence results with critical 
growth. 

Let us introduce the precise assumptions of F’. From now on, we fix 1 < p, gq < N, and 
so the functional F will be defined in the Banach space W!-P(2) x W!:4(Q). Of course, 
the growth of F has to be controlled in order for ¥ to make sense for (u, v) € W!P(2) x 
W'-4(Q). According to the Sobolev trace embedding, we impose 


|F(x,u, v)| <C(1 + |ulP* + |v|*), (Fi) 
where p, = p(N — 1)/(N — p) and q, = q(N — 1)/(N — q) are the critical Sobolev 


trace exponents and C is some positive constant. With (Fj), as W!P(Q) > LP*(8Q) and 
wi4 (2) + L%(d&2) by the Sobolev trace theorem, we have that F is well defined. 
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In order to apply variational techniques, we need the functional F to be C!. To this end, 
(F;) is not enough. One has to consider the stronger assumption 


| Fux, U, v)| < c(1 Aly |Pe} ae |v| t(D / Ps), 


(F2) 
bares u, v)| < c(1 + |v|a—! a [us |P*—D/ as) 


One can easily check that (F2) implies (F;) and under (F2), it follows that critical points 
of F are weak solutions of (11.30)—(11.31). 

Now, the geometry of F depends strongly on the precise growth of the potential F. That 
is, on the exponents 7 and _s in the inequality 


[FG u,v)| <C(1+ lal” + lf’), (F3) 


where r < px and s < qx. 
Of course, the case of interest is 


F(x,0,0) = Fy (x, 0,0) = Fy(x, 0,0) =0 forx ed, (F4) 


then vu = v = 0is a trivial solution of the system (11.30)-(11.31). 

We will distinguish mainly four different cases: 

(1) r < pands < q. (Sublinear-like.) 

(2) r = p ands = q. (Resonant.) 

(3) p<r< px and gq <s < qx. (Superlinear-like, subcritical.) 

(4) r= px and s = qx. (Critical.) 

First, we turn our attention to the superlinear and subcritical case (3). In order to ver- 
ify the Palais-Smale condition, we need to impose the following assumption: There exist 
R > 0, 6p and 6, with @p < 1/p, 0g < 1/q, such that 


0< F(x, u,v) <Op,uF, (x, u,v) + Ogu Fy (x, u, v) (F5) 
for all x € 02 and |u|, |v| > R. We have the following theorem. 
THEOREM 11.12. Assume that the potential F satisfies (F2), (F3) with r,s as in (3), 
(F4) and (Fs). Assume, moreover, that there exists constants c > 0 and ¢ > 0 and 
Dx > > DP, qx > S > q such that 


|F(x,u,v)|<c(lul’ + lvl’) forx € dQ, |ul, |u| <e. (Fe) 


Then F has a critical point. If, moreover, F is even then F has infinitely many critical 
points which are unbounded in W!:P (Q) x W'4(Q). 


Case (1) is similar in nature to a sublinear problem for the usual Laplacian. So, direct 
minimization yields a nontrivial solution. However, under a hypothesis similar to (F5) we 
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can show the existence of infinitely many solutions (of course, with an oddness assumption 
on F). The condition is: There exists R > 0, 0, and 0, with 0, <1/p, 6, < 1/q, such that 


OpuFy (x, U, v) re Ogu Fy (x, U, v) ~ F(x, Uu, v) 2 —c(|u|" a |v|*) (F7) 
for all x € 02 and |u|, |v| > R. We have the following theorem. 


THEOREM 11.13. Assume that the potential F satisfies (Fr), (F3) with r,s as in (1), 
and (F4). Then F has a nontrivial critical point providing there exists a constant R > 0, 
6 <1 and a continuous function K :082 x R x R= R such that 


F(x, t!/Py, t'/4y) > 19K (x, u,v) 
for x € 02, |u|, |v] < Rand small t > 0. (Fg) 


If, moreover, F is even and (F7) holds, then F has infinitely many critical points which 
form a compact set in W'P(Q) x W'-4(Q). 


The case (2) is a resonant problem. So there is an underlying (nonlinear) eigenvalue 
problem. In this case, it is natural to assume a condition on F that implies that the func- 
tional F satisfies the so-called Cerami condition. This assumption is as follows: There are 
positive constants c, R,a, b with0 <a < p,0 <b <q such that 


1 1 sale nant 
—uF,(x, u,v) + —vF,(x,u, v) — F(x, u, v) 2 e(|ul? + lvl”) (Fo) 
P q 


for x €0Q2, |u|, |v] > R. 

In order to avoid resonance, we need to understand the underlying eigenvalue problem. 
A similar eigenvalue problem for the Dirichlet boundary condition case, was introduced 
in [17]. Let G: R? > [0, 00) bea C! positive even function such that 


G(t'/Pu, t'/4v) =tG(u, v), (Gi) 
G(u,v) <k(lul? + |v]4). (G2) 


The eigenvalue problem is 


Apu=|ul?u in &, 
Aqv= |v|9-7v, 
(11.33) 
| [Vu|P-? 4 —aG, =AlulP-2u on a2, 


290 = 
|Vult- 7 —aG, =Alvltv, 


where ae L® (022). 
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We will see that problem (11.33) has a first eigenvalue 4;(a). So in order to avoid res- 
onance, we assume that there exists positive numbers R and ¢, and a,b € L® (a2) such 
that 


A1(a) <0, F(x,u,v) >a(x)G(u,v), |u|, |v] > R, 
(Fi0) 
41 (b) > 0, F(x, u,v) < b(x)G(u, v), jul, |v| <e, ~ 


where G and G satisfy (G;). We have the following theorem. 


THEOREM 11.14. Assume that the potential F satisfies (Fr), (F3) with r and s as in (2), 
(F4), (F9) and (Fo). Then the functional F has a nontrivial critical point. 


Now we turn our attention to the critical case (4). As it is well known, the compactness 
in the immersion W!:?(2) x W!-4(Q) > L?*(82) x L% (92) fails, so the functional F 
does not verify the Palais-Smale condition. However, by applying the concentration— 
compactness method (see [96,97]), we can prove that F satisfy a local Palais—Smale con- 
dition that will suffices to apply the usual variational techniques. 

The hypotheses on the potential F are 


F(x,u,v) = F(x, u,v) = F°(x, u, v) +AFS(x, u,v), (Fi1) 
where F° is the critical part of F), and F° is a subcritical perturbation, that verifies (F3) 


with r and s as in (1) or (3). 
The hypotheses on the critical part F° are: There exist two constants c, C > 0 such that 


c(|ul?* + lvl) < Fix, u, vu + Fo(x,u, v)v < C(lul* + |vl®), (F¢) 
c(luel?* + [vl%) < Op FS (x, u, v)u +O, FS (x, u, vv — F(x, u,v), (FS) 


where 6, and 6, are defined for the two cases in (F5) and (F7). 
For the subcritical perturbation F'*, we need also to impose the following condition, 


Fi (x,u,v)u + Fy (x,u,v)v <C(1+ ul” +Iv)°). Fp) 
We have the following theorem. 


THEOREM 11.15. Assume that F), satisfies (F\,) with F* satisfying (Fz), (F3) with r and s 
as in (3), (Fa), (Fs) and (F; ) and F° satisfying (FY) and (F5). Then there exists a constant 
A >0 such that, if 1 > A, F has a critical point in W':? (Q) x W'4(Q). 


Finally, for sublinear perturbations we have the theorem. 


THEOREM 11.16. Assume that Fy, satisfies (F,) with F* satisfying (Fz), (F3) with r and s 
as in (1), (F4), (F7) and (F}) and F° satisfying (F{) and (FS). Then there exists a constant 
A > 0 such that, if 0 << A, F has a nontrivial critical point. Moreover, if F is even 
then F has infinitely many critical points in W'? (2) x W'4(Q). 
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12. Other results 


In this section we collect more results for elliptic problems with nonlinear boundary con- 
ditions. 

¥ Brock in [23] prove the following isoperimetric result concerning eigenvalues of the 
Steklov problem, 


Au=0  inQ, 
| (12.1) 


gu =Apu onds, 

where p € L™ (02) is positive. 
THEOREM 12.1. Let |Q|=|B(O, R)| and i; the sequence of eigenvalues of (12.1), then 
V1 NeyRN-! 

$41 fig Ip do’ 


i= 


¥ In [41] Davila and Montenegro study nonnegative solutions of the problem 


Au=u in Q, 
(esrb oaee on 02 ON {u > 0}. 


Remark that for this problem a free boundary appears, the solution is allowed to vanish on 
some part of the boundary and hence it develops a free boundary, the boundary of the set 
{u > 0} 082. The authors show that, under adequate hypotheses on f/f, there exists a non- 
trivial maximal solution and also find conditions under which it develops a free boundary. 
Also, some regularity results are provided. 

¥ Let us recall that in [38] it is proved the well-known maximum/antimaximum prin- 
ciple for the linear Laplace operator with zero Dirichlet boundary condition. Denoting 
by ,41 the first eigenvalue of the Laplace operator (with zero Dirichlet boundary condi- 
tion), it states that “given any positive h € L'(92), r > N, there exists ¢ = e(h) > 0 such 
that every solution u of —Au = hu +h in Q with ulag =0 satisfies either u <0 in 2 
provided that 4, < & < 4, + € (antimaximum principle), or u > 0 in Q if uw < fy” (max- 
imum principle). 

Our main goal now is to extend the maximum/antimaximum principle to the case of 
elliptic equations with nonlinear boundary conditions, 


—Autu=h in, 
| (12.2) 


ou =hu+g ond”. 
We have the following result, see [14] for a proof. 


THEOREM 12.2. Leth € L’(92) and g € L*(0Q) withr > N/2 ands > N — 1. Let 


A= | ho dx + | ggido. 
Q a2 
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(1) If A > 0 then there exists ¢ > 0 such that every solution of (12.2) with hj —€ < 
A < Aq verifies u > Oin 2 and every solution of (12.2) witha, <2 <1 +68 verifies 
u<O0in®. 

(2) If A <0 then there exists ¢ > 0 such that every solution of (12.2) with hj —€ < 
A < Aq verifies u < Oin 2 and every solution of (12.2) with ar, << 11 +8 verifies 
u>Oing. 

(3) If A=0 then every solution of (12.2) with 2 4d, changes sign in Q. 


With respect to the proof of this theorem, we emphasize that the main idea is to look at 
the problem from a bifurcation (from infinity) point of view like in [13]. 

Note that for the Neumann boundary condition we are just assuming that h is in L’ (92) 
with r > N/2. This is in contrast with the case of Dirichlet boundary condition in [38] 
where it is assumed r > N. This strengthened assumption is necessary for the Dirichlet 
case. Indeed, it is proved in [116] that there exists a positive function h € LN(Q) for 
which the antimaximum principle does not hold; that is, the space L’(§2) with r > N is 
sharp for this principle. 

We also have that L/2(Q2) and LN~!(8Q) are sharp for the antimaximum principle 
in the case of Neumann boundary conditions. First, let us see that antimaximum principle 
does not hold, in general, for h € EXPO), 


THEOREM 12.3. There exists a positive function h € LN/?(Q) such that the solution 
of (12.2) with g =0 and i > i, is positive somewhere in Q2. 


Also, the hypothesis g ¢ LN~!(2) is not sufficient to obtain the antimaximum princi- 
ple. 


THEOREM 12.4. There exist a bounded domain Q and a positive function g € LN~!(8Q) 
such that the solution of (12.2) with h =0 and 2X > i, is positive somewhere in 92. 


v The authors of [19] study questions of existence, uniqueness and continuous depen- 
dence for semilinear elliptic equations with nonlinear boundary conditions, B(u) — Au > f 
on &2, uy (y) € 0 on 082, where f € L'(Q). The nonlinearities B and y are maximal 
monotone graphs in R. In particular, the authors obtain results concerning the continuous 
dependence of the solutions on the nonlinearities in the problem, which in turn implies 
analogous results for a related parabolic problem. 

See also [9] and [12] where it is proved existence and uniqueness of solutions to equa- 
tions of the form u — diva(x, Du(x)) = f in 92, supplied with the boundary condition 
=f € B(u) on 082, where f € L!(@); and 0/(dvq) is the Neumann boundary operator 
associated to a, that is, du/dvg = (a(x, Du(x)), n) and B is a maximal monotone graph 
in R x R with 0 € B(0). As a consequence of the existence—uniqueness result, the au- 
thors associate an m-complete accretive operator in L!() to the corresponding parabolic 
equation, which permits them to study that equation from the point of view of nonlinear 
semigroup theory. 
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V Now, following [42], we deal with self-similar solutions of the porous medium equa- 


tion in a half-space with a nonlinear boundary condition. We study existence and symmetry 
of nonnegative solutions of the following problem 


(12.3) 


du 


foe in RY, 
ae IRN 
yp —U on ORY, 


where 0 < a < 1. This elliptic problem appears naturally when one considers self-similar 
blowing up solutions of the porous medium equation (m > 1) 


v,=Av™ inR” x (0,7), 
(12.4) 


a” =v" on dRY x (0,7). 


The blow-up problem for the porous medium equation has deserved a great deal of atten- 
tion, see for example the survey [78]. In the study of blow-up problems, self-similar profiles 
are used to study the fine asymptotic behavior of a solution of the parabolic equation near 
its blow-up time. It often happens that the spatial shape of the solution near blow-up is 
close to a self-similar profile, see [78]. 

In our case, assume that u(x, t) is a solution of (12.4) with blow-up time T. Then the 
rescaled function z(x, t) = (T —t)!/@"— v(x, t) should converge as t 7 T to a stationary 
profile z(x) satisfying 

Az" = az in RY, 


m se 
ae St on 0 RY, 


as is often the case when dealing with parabolic problems. Then u(x) = cz(x)” is a so- 
lution of (12.3) with a = 1/m for a suitable choice of the constant c. On the other hand, 
given a nonnegative solution u(x) of (12.3), z(x) = (u(x)/c)!/” gives rise to a special 
solution to (12.4) (in self-similar form) blowing up at time 7, of the form v(x,ft) = 
(T — t)~!/™-Dz(x). Remark that in our case the self-similar scaling does not change 
the spatial variable, and hence the blow-up set is given by the support of z(x). Therefore 
there is an interest in studying self-similar profiles, in our case solutions of (12.3). In order 
to motivate our study, let us recall what is known for the problem 


v,= Av" +0" inRY x (0,T). (12.5) 


Problem (12.5) admits self-similar solutions. In this case the profile z(x) is a solution of 


O=Az™ 4+ 2" — 


1 
ve in RY. (12.6) 


One way to look for solutions of (12.6) is to search for radial ones. The existence of a 
radial compactly supported nontrivial solution reduces to the study of an ODE and was 


398 J.D. Rossi 


done in [40]. Moreover, a symmetry analysis using moving planes implies that every solu- 
tion with finite energy has compact support and is composed by a finite number of radial 
“bumps” located such that their supports do not intersect, see [40]. 

Concerning the existence of solutions of (12.3), let us observe that in one space dimen- 
sion we are facing an ODE that can be solved explicitly. It turns out that there exists only 
one compactly supported solution in R;, u(x) = c1((cz — x)+)°/7-™. Unfortunately, for 
N > 2, an easy inspection of problem (12.3) shows that there is no hope to look for radial 
solutions since they cannot verify the boundary condition. Therefore, in the case under 
study, the elliptic problem remains a PDE that cannot be solved by ODE methods. How- 
ever, the problem has still some natural symmetry in the tangential variables. In fact, if we 
call a point x € RY, x = (x’/,xy) (x’ € RN~!), we can search for solutions that are radial 
in the tangential variables, that is, 


u(x) = u(|x’|, xy). (12.7) 
It has to be noted that this symmetry assumption does not reduce the problem to an ODE. 
The first result of [42] reads as follows. 


THEOREM 12.5. There exists a nontrivial, nonnegative, compactly supported solution 
of (12.3) of the form (12.7). 


Next, we use the moving planes device (with a moving plane parallel to the xy direction) 
to prove the following result that justifies our symmetry assumption in Theorem 12.5. 


THEOREM 12.6. Let u € H'(R*) be a nonnegative solution of (12.3) with connected 
support. Then u is compactly supported and radial in the tangential variables, that is, it 
has the form (12.7). 


The problem of uniqueness of solutions to (12.3) with compact support remains open. 
In the case of equation (12.6), it is known that solutions with compact support are unique 
except for translations, but the argument relies strongly on ODE techniques. 

When this analysis is performed we can obtain some easy corollaries concerning prob- 
lem (12.4). 


COROLLARY 12.1. Every nonnegative nontrivial solution of (12.4) blows up in finite time. 


The proof of this fact follows by contradiction. Assume that v is a global nontrivial 
solution. As v is a supersolution of the porous medium equation its support expands, [123], 
and eventually covers the support of a self-similar profile z. The proof ends just with the use 
of a comparison argument using a self-similar solution with T large enough as subsolution. 


COROLLARY 12.2. There exists a solution of (12.4) with a blow-up set composed by an 
arbitrary number of connected components. 


In fact, we may consider a self-similar solution with a profile z(x) composed by n dis- 
joint copies of the compactly supported solution provided by Theorem 12.5. 
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Vv Now we study weak solutions for the p-Laplacian with a nonlinear boundary condi- 
tion at resonance, see [101]. We look for conditions that provide existence of weak solu- 
tions for the problem 


Au = |ulP—2u + f(x,u in 2, 
| pu = |u| f(x, u) sis 


[VulP-?7 4 = Alw|P-2u — h(x,u) ond. 


We assume that the perturbations f:2 x R— R and h:d2 x R— R are bounded 
Carathéodory functions. In a variational approach, the functional associated to the prob- 
lem is 


1 1 Xr 
Idu)y=— | |VulPdx+— ] |ulPdx — — |u|? do 
PJQ PJQ P Jae 


+f Fo.wax+ [ A(x, u)do, 
2 a2 


where F and 4 are primitives of f and h with respect to u, respectively. Weak solutions 
of (12.8) are critical points of J), in W!P(Q). 

Let us introduce some motivation to deal with (12.8). As we mentioned before, we will 
say that 4 is an eigenvalue for the p-Laplacian with a nonlinear boundary condition if the 
problem, 

fee \u|P-2u in Q, 
(12.9) 


[VulP-7 34 = Alu|P-2u on a, 


has nontrivial solutions. The set of solutions (called eigenfunctions) for a given 4 will 
be denoted by A,. Resonance problems are well known in the literature. For exam- 
ple, for the resonance problem for the p-Laplacian with Dirichlet boundary conditions 
see [13,49] and references therein. In problem (12.8) we have a perturbation of the eigen- 
value problem (12.9) given by the two nonlinear terms f(x, uw) and h(x,u). Following 
ideas from [49], we prove the following result, that establishes Landesman—Lazer-type 
conditions on the nonlinear perturbation terms in order to have existence of weak solutions 
for (12.8). 


THEOREM 12.7. Let f* = limy-++oo f(x, t), AT = lim;— +00 A(x, f). Assume that 
there exist f € L4(Q) and h € L4(082) such that | f(x,t)| < f V(x,t) € 2 x R and 
|h(x,t)| <<h V(x, t) € OQ x R (where gq = p/p — 1). Also assume that either 


ayy: f pros f htv 
{v>0NQ} {v>0N082} 


+ pus [ h-v>0_ forall v € A;\{0} 
{v<0NQ} {u<0Nd2} 
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or 


ayy: f pros f h*v 
{v>0NQ} {v>0Nd2} 


+f pos f h-v <0 forall v € A,\{0}, 
{v<0NQ} {v<0Nd2} 


then (12.8) has a weak solution. 


Observe that in the case where A is not an eigenvalue the hypotheses trivially hold. The 
integral conditions (of Landesman—Lazer type) that we impose for f and h are used to 
prove a Palais—Smale condition for the functional J, associated to the problem (12.8). 
Observe that these conditions involve an integral balance (with the eingenfunctions v as 
weights) between f and h. Hence we allow perturbations both in the equation and in the 
boundary condition. 

Let us have a close look at the conditions for the first eigenvalue. As the first eigenvalue 
is isolated and simple with an eigenfunction that does not change sign in (2 (we call it ¢) 
and assume ¢; > 0 in 2) [100] and Section 6, the conditions involved in Theorem 12.7 
for 4; read as 


(LL); : / Fords + [ h*o\do >0 and 
Q 02 


[ react | h $\do <0 
2 02 


or 


(LL);: [re a+ [ ht odo <0 and 


[ roars | h” $\do > 0. 
2 02 


For this case, 4 = 41, we will prove a more general result which improve the conditions 
on f and h. In [13] the resonance problem for the Dirichlet problem was analyzed using 
bifurcation theory. If we adapt the arguments of [13] to our situation, using bifurcation 
techniques to deal with (12.8), we can improve the previous result by measuring the speed 
and the form at which f and h approaches the limits f* and h~, see [101] for the details. 

Vv We end this section with the study of the Fucik spectrum and a resonance problem 
for the p-Laplacian with an asymmetric nonlinearity at the nonlinear boundary condition. 
We want to find existence results for elliptic problems involving the p-Laplacian with a 
nonlinear flux boundary condition. More precisely, we look for solutions of 


Apu = A(x, u) in £2, 


12.10 
[Vul?—? 34 = Bix,u) on a8. ( ) 
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We assume that A(x, uw) and B(x, u) behave like 


A(x, u) = |ul?-u — f(x, u), 
B(x, uw) =a(ut)?! — BWP + h(x, w), 


where f and h are lower-order terms. Hence we are assuming that we deal with a resonance 
problem with an asymmetric nonlinearity at the flux boundary condition. 

To study this problem, as happens for the usual Dirichlet boundary conditions, we 
first have to make an analysis of the associated spectrum. The Fucik spectrum for the 
p-Laplacian with a nonlinear boundary condition is defined as the set > p of (a, B) € R? 
such that 


Apu =|ul?-*u in Q, 
(12.11) 


|Vu|P-2 = a(ut)?!— pure! on ae 


has a nontrivial solution. If a = 6 = A then we arrive to our old friend, the eigenvalue 
problem, 


(12.12) 
|VulP-7 84 = Alu|Pu on a. 


Let us go back to (12, 11). We observe that if 4 is an eigenvalue for (12.12) then the 
point (A, A) belongs to I Moreover, the lines R x {41} and {A;} x R belong to zs, this 
follows from the fact that “the first eigenfunction is positive. 

The main results for this problem can be summarized as follows: first we have a first 
nontrivial curve in ae We also have that the lines R x {A;} and {A;} x R are isolated 
in bx and that the curve is the first nontrivial curve. This implies in particular that this 
curve passes through (A2, 42) which yields a variational characterization of the second 
eigenvalue A2 by a mountain-pass procedure. The first curve is monotone and its asymp- 
totic behavior is similar to the Dirichlet problem if p < N and in the case p > N it is 
similar to the homogeneous Neumann problem. We also find a sequence of curves locally 
around a suitable sequence of variational eigenvalues (A,, Ax). 
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Abstract 


We describe classical and recent results on the spectral theory of Schrédinger and Pauli 
operators with singular electric and magnetic potentials. 
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1. Introduction 


Analogous to Newton’s equations, describing the motion of macroscopic bodies, from 
falling apples to space crafts orbiting the Earth, the Schrédinger equation describes mi- 
croscopic phenomena, from the simplest atoms to processes inside stars. The differential 
operator appearing in the Schrodinger equation, the so-called Schrédinger operator, char- 
acterizes the physical system and it is therefore one of the most interesting objects in Math- 
ematical Physics; its spectral theory has deep roots in nonrelativistic quantum mechanics. 
A number of mathematical notions and theories were inspired by the needs of the theory 
of the Schrédinger operator and its generalizations. Formally, the Schrédinger operator is 
obtained from the Hamilton function describing the classical system by some vaguely de- 
fined “quantization” procedure. So, if the classical Hamiltonian is H(p,q) = p? + V(q), 
p.q € R¢ being the momenta and coordinates, the corresponding Schrédinger operator 
is H =—A+ V(x) in L?(R®).! A number of questions arise immediately, in particular, 
about defining H as a self-adjoint operator in a proper Hilbert space and on determining its 
spectral properties on qualitative and quantitative level. As a result of the activity of many 
mathematicians starting in the 1950s, a rather complete set of answers to these questions 
was found, under regularity conditions on the potential V, more and more relaxed with 
time. Later, the researchers directed their interest also to the operators involving not only 
an electric field with potential V(x) but also magnetic fields: the magnetic Schrédinger 
and Pauli operators. Here passage from regular to more singular potentials presented even 
harder mathematical problems. During the past several years, fundamental results con- 
cerning Schrédinger and Pauli operators with very singular potentials were obtained. So 
far these results are restricted to the qualitative questions of spectral theory, self-adjoint 
realizations, semiboundedness, discreteness of the whole or the negative spectrum. The 
quantitative results on the spectrum lag behind at the moment. 

There are a number of sources dealing with the spectral theory of the Schrédinger oper- 
ator. We name, first of all, the books [13,17,27,29,32,54,63,79, 112—-114,120,123,131] and 
references therein. 

An extensive presentation of the spectral theory, even restricted to the most important 
operators in Mathematical Physics, would be far beyond the frames of a 100-pages review 
paper. We decided to cover “‘extreme parts” of the theory. We describe the setting of the 
main problems, some classical ideas and methods, and then pass to the most recent results 
in the field, not pretending to cover the whole multitude. We concentrate in our exposi- 
tion on the most singular cases. This means that we are interested in such results where 
the conditions on the magnetic and electric potentials are relaxed, as far as possible. This 
requires often a new understanding of the problem, new ideas, and always overcoming con- 
siderable technical difficulties. In many cases the need for such extensions of mathematical 
knowledge is inspired by physical and technical needs. This choice, however, restricts the 
selection of the material to be presented in our review. We do not provide a survey, for 
example, over the vast landscape of microlocal methods in spectral theory [58,123] (where 
spectacular developments follow one another during the last decennia) since these methods 


! Traditionally, both +V and —V occur in the notation. Not breaking the traditions, we apply both notations in 
the text, specifying explicitly which one is used in a particular place, so this must not cause a confusion. 
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require considerable regularity of the problem. We do not touch upon the exciting topic of 
scattering theory describing the large time evolution of quantum systems; it surely deserves 
separate expositions. We also leave aside such important fields as the theory of operators 
with periodic, almost periodic and random coefficients, as well as the study of the asymp- 
totic properties of eigenvalues and other spectral characteristics of Schrodinger operators, 
see, e.g., [120] for some basic facts and references about these topics. 

Obviously, we cannot go into all technical details, which the interested reader has to 
look for in the literature, but we try to explain the main ideas and the driving forces of the 
proofs. 

The structure of the chapter is the following. Part 1 (Sections 2—6) is devoted to the qual- 
itative spectral analysis. We consider two central questions: how to define the Schrédinger- 
type operator as a self-adjoint operator in a suitable Hilbert space, and what information of 
the structure and location of the spectrum one can obtain. 

We begin with a description of the three main objects considered in the chapter, the 
Schrédinger operator, the magnetic Schrédinger operator and the Pauli operator. Of course, 
the first one is just a particular case of the second operator. However, not only the tradition 
advises to consider the nonmagnetic operator as a separate object of study, but the results 
for this operator are most complete and, at the same time, methods of the spectral analysis 
are usually invented for the Schrédinger operator, and further adapted and extended to more 
complicated cases. The Pauli operator is the first stage in taking into account relativistic 
features: it involves the interaction of the spin with the magnetic field. 

Having described our operators formally, we have to define them as self-adjoint opera- 
tors in a Hilbert space. The operators are self-adjoint only formally, so the task is to de- 
scribe the proper domain of definition and the action of the operators on this domain. Only 
then one can develop the spectral theory. We discuss the general self-adjointness problem 
in Section 3, where, in particular, we explain the perturbation approach. The comfortable 
case here is when the operator, defined initially on some “nice” set, is essentially self- 
adjoint, which means that there is just one “natural” self-adjoint realization of the operator. 
This usually happens in “regular” situations. Recently, however, a substantial progress took 
place even in this classical field, and we describe these results in Section 4. 

In more singular cases, a less explicit method of quadratic forms is needed to define the 
operator. It requires by far less regularity of the potentials. One can apply this method, not 
only for defining the operator but also for studying its spectrum, as soon as the necessary 
facts from the theory of functional spaces are obtained. These facts concern conditions 
for certain functional inequalities to hold, relating the quadratic form of the operator (the 
Sobolev space norm of the function, in the simplest case) and the norm of the function 
in some weighted space. Physically, it amounts to controlling the potential energy of the 
system by the kinetic one. The mathematical problem lies in the study of boundedness, in- 
finitesimal boundedness and compactness of embeddings of Sobolev-type spaces in spaces 
of functions square-integrable with respect to some specified measure. We devote a ma- 
jor part of Section 5 to the explanation of basic facts and a description of the most recent 
results in the field of such functional inequalities. Having abstract perturbation theorems 
(presented in Section 3) at hand, one arrives at self-adjointness results. 

Beginning from Section 6 we proceed to spectral theory. The questions addressed here 
concern the qualitative structure of the spectrum: is the negative spectrum empty, finite, 
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discrete, or is the whole spectrum discrete. In other words, it is about eigenvalues, or bound 
States in the physical terminology. 

Generally, if E is an eigenvalue of the operator H describing the quantum system 
and ug is the corresponding eigenfunction, then the evolution of the system, governed 
by the Schrédinger equation iv = Hwy with the initial state (0) = wz, has the form 
w(t) = ug exp(—it E). Thus the (physically sensible) absolute value of the solution does 
not depend on f¢ and the system is in a stationary (bound) state. Such states correspond to 
closed orbits in Bohr’s classical theory of quantum systems. The study of eigenvalues of 
Schrédinger-type operators is important for Physics and Chemistry, since they determine 
the main properties of the physical systems. In Mathematics, the properties of eigenvalues 
of various operators have deep relations in real and complex analysis, partial differential 
equations, geometry, stochastic analysis and other topics. 

One of the most powerful instruments in the qualitative, as well as in quantitative spec- 
tral analysis, is the Birman—Schwinger principle which relates the properties of eigenvalues 
of Schrédinger-type operators to the properties of embedding operators. In Section 6 we 
discuss this principle, and using results on embedding operators, we give answers to the 
questions above, starting from the most simple, classical ones, requiring a considerable 
regularity of the potentials, up to the most recent developments related to much more sin- 
gular situations. In some cases, the results we discuss here are final in the sense that they 
give necessary and sufficient conditions for the spectral properties in question to hold. 

The second part of the chapter is devoted to the quantitative spectral analysis of our op- 
erators. Here, again, a selection of material was necessary, and our choice, of course, was 
influenced by our own research interests. We present several topics concerning estimates 
of eigenvalues of Schrédinger-type operators. Such results are important for physical ap- 
plications, especially in quantum mechanics, and the corresponding formulas have deep 
physical roots. 

We consider the negative eigenvalues —E; of the Schrédinger-type operators Hy = 
Ayp-V (= —hA— V) in L?(R®); here f is the Planck constant divided by 22. Informa- 
tion on their number N (0; Hy) and their sum are important for physical applications. 

From the “old quantum theory” one has the somewhat mystical Bohr—Sommerfeld quan- 
tization condition that “each nice set in the classical phase-space with volume (21h) can 
accommodate one eigenstate of H”. Hence, heuristically, one expects that 


N(0; Hy) ~ (22h)~4 II dx dé, 
{((x,8)|H (x,€) <0} 


where H(x,&) = |é|? — V(x) is the corresponding (classical) Hamilton function. For the 
standard Schrédinger operator — A — V one obtains that 


N(O; -A-V)~ ia, V4. (x)9? dx; (1.1) 


here V(x) = max{V(x), 0}, and Loa — (2nh)~4 aq is the classical constant, wq = 
4/2 /Td+ a) denotes the volume of the unit ball in R?, P(@), a > 0, denotes the Gamma 
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function '(@) = ie t?—le~! dt, and the meaning of the symbol ~ has to be further speci- 
fied. The right-hand side of (1.1) is usually referred to as the phase-space volume. 

It was only in the 1970s that this formula was mathematically justified. The result, the 
CLR estimate states that in dimensions d > 3 the left-hand side in (1.1) is estimated from 
above by the right-hand side times some constant, depending on the dimension d only, viz. 


N(O; Hv) <Ca | Vi. (x)4/? dx. (1.2) 
Rd 


Estimate (1.2) belongs to the “singular” theory from the very beginning: the only condition 
is finiteness of the integral on the right-hand side. 

This estimate, as well as its generalizations to other operators, proved to be very helpful 
in many problems in Spectral Theory and Mathematical Physics. To get a better under- 
standing of it, improve the constant, and generalize it to other classes of operators, several 
alternative proofs were proposed, using quite different mathematical machinery. We de- 
scribe here, in Section 7, several approaches to proving (1.2), including the most recent, 
and probably the most abstract one, based on the analysis of positive semigroups. Abstract- 
ness of the method enables one to carry over the estimate to a wider class of operators, 
including many operators with magnetic fields, discrete operators, operators on manifolds, 
some relativistic operators, etc. We present also the recent important generalization of the 
CLR estimate to the case of the Schrédinger operator acting in a space of vector-valued 
functions. 

One of the important applications of the CLR estimate lies in finding asymptotic for- 
mulas for N(0; Hy) as some of the parameters tend to zero (or oo). For instance, when 
h — 0, one talks about the semiclassical asymptotics, and the uniformness of the esti- 
mate (1.2) was crucial in justifying the heuristic formula (1.1) asymptotically. It holds, 
again, as long as the integral on the right-hand side is finite. On the other hand, one can 
replace V by gV, g being a coupling constant, and get the asymptotics of N(0; Hgy) as 
g — oo [15,88], 


N(O; Hev) 


lim sar a Qnnytos | Vi (x) 4? dx; (1.3) 
R 


goo 
this is the strong-coupling limit. 

In proving this and many other asymptotic results, one usually establishes the asymp- 
totics first for some nice, say, smooth and compactly supported potentials and then applies 
the CLR estimate together with methods from perturbation theory of linear operators (see 
Section A.11) to extend the asymptotics to all potentials. We do not discuss this kind of 
asymptotic formulas in this chapter, referring the reader to [32,120] and references therein. 

However, in relation to the asymptotics (1.3), the following question arises. Consider the 
sum of the negative eigenvalues taken to some power y > 0, 


Sy,a(V) = ~~ ie. 


—E;<0 
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By means of formal integration in (1.3), one arrives at the asymptotics 


. SydV) _o¢ d/2+y 
oan dy = Lid 2 Vi(x) dx (1.4) 
with a certain constant L*, ,. Is this, formally obtained, asymptotics correct? 
Information about S,,~(V) and especially estimates of the form 


SV Sha a Vi (x)t7*Y dx, (1.5) 


which are called Lieb-Thirring inequalities, turned out to be crucial in the study of stabil- 
ity of matter in nonrelativistic and relativistic quantum mechanics. Again, as soon as the 
estimate (1.5) is established, the asymptotics of the form (1.4) follows by perturbational 
reasoning. The physical applications require knowledge of the optimal constant, and it is 
only recently that essential progress was made here. In Section 8 we discuss these, as well 
as classical results in detail. 

In Section 9 we present an abstract approach to obtaining eigenvalue estimates for oper- 
ators with magnetic fields. The basic point here is an important property, the diamagnetic 
inequality, saying, in application to the magnetic Schrédinger operator, that the kernel of 
the Green function of the heat semigroup generated by this operator is pointwise majorized 
by the Green function of the analogous semigroup generated by the nonmagnetic opera- 
tor. We discuss both classical and recently found methods for establishing diamagnetic 
inequalities and present their use in spectral theory: any, sufficiently regular eigenvalue 
estimate for the nonmagnetic operator is inherited by the magnetic one. This general ob- 
servation fails, however, in the case of the Pauli operator, since it does not possess the 
diamagnetic property, on the contrary, a paramagnetic property is excepted, with the op- 
posite monotonicity. 

One of the complicating features for Pauli operators is the presence of so-called zero 
modes. The Pauli operator, even without electric field, may have zero as an eigenvalue, 
and its multiplicity, especially if it is infinite, influences significantly the behavior of the 
spectrum under perturbations. We describe in Section 10 how these zero modes can arise 
and present the latest results dealing with their study. 

In Section 11 we consider the perturbed Pauli operator. Its spectral properties are con- 
siderably more complicated and less known than the ones for the magnetic Schrodinger 
operator. In particular, one must not expect that an analogy of the CLR estimate is valid 
here. Lieb-Thirring-type inequalities are looked for, with stability of matter problems al- 
ready waiting. Unlike the Schrédinger case, there is no natural candidate for the form of 
such an inequality. We present the proof of the Lieb—Thirring inequality for the case of a 
constant magnetic field, the hardest proof we have taken a risk to include, and then describe 
the latest developments concerning Lieb-Thirring inequalities for nonconstant magnetic 
fields. 

The spectral theory of differential operators is based heavily on the abstract spectral the- 
ory of operators in Hilbert spaces. We think, moreover, that the more abstract formulation 
(or proof) of a result in the theory of partial differential equations is found, the deeper 
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is the understanding of particular ideas and engines involved, and the more possibilities 
exist to generalize the results. Therefore we try to emphasize, where possible, the abstract 
operator theory content of the concrete considerations for differential operators. 

We assume that the reader knows the basic facts about linear operator theory in Hilbert 
spaces; we include in the Appendix some more specialized information, concerning 
quadratic forms, variational description of the spectrum (e.g., Glazman’s lemma) and the 
Birman—Schwinger principle, thus relating the spectral properties of the operator to prop- 
erties of embeddings for Sobolev-type Hilbert spaces. The Appendix contains also some 
useful facts from the theory of compact operators in Hilbert spaces. To the interested reader 
we, nevertheless, strongly advise to preclude the study of the paper by a more fundamental 
study of the abstract theory found in, say, [17,114] or [155]. 


2. Main operators 


In this review we consider three important operators of Mathematical Physics: the 
Schrédinger operator, the magnetic Schrédinger operator and the Pauli operator. We begin 
by defining them formally, as differential expressions or differential operations, without 
discussing particular regularity conditions for coefficients, reserving the word operator to 
operators in a Hilbert space, with a specified domain. 


The Laplacian. The (negative) Laplace operator in R¢ is denoted by —A. The Hilbert 
space usually will be L?(R%) with Lebesgue measure dx. We consider also the Laplace— 
Beltrami operator on Riemannian manifolds. Given a manifold M with metric tensor g jx 
in local coordinates, we define the Laplace—Beltrami operator —A, as 


i =e? 5°; glk gl/2 9 (2.1) 


where {g/*} is the matrix, inverse to { gjk}, and g = det g;x. The Hilbert space here is 
L?(M, p(dx)), where the Riemannian measure p= has local density gl/ . 


Magnetic Laplacian. Let A(x) = (Aj(x))j=1,..,¢ be a real vector-valued function 
in R¢, called the magnetic potential. The components of the magnetic gradient V4 = 
(Pi,..., Pa) are Pj = Pj, 4 = 0; +1Aj(x) and the magnetic Laplacian is defined by the 
differential operation 


—A,j,=- Leis ->( (0; +iA; ja)’. (2.2) 
J 


The matrix-valued function (in fact, distribution) B = curl A = { Birks pay Bik = Oj Ak 
0xAj;), is called the magnetic field. Under certain, rather weak, regularity conditions, op- 
erators corresponding to different magnetic potentials but the same magnetic field B are 
related by a unitary equivalence relation, the gauge transformation, 


—Aqz=e'*(-Aye®, (2.3) 
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provided 
V@=A-A, VxA=VxA. (2.4) 


This equivalence is discussed in [71,72]. The gauge ¢ must be a function in Ee. If such 
an equivalence takes place, the operators with magnetic potentials A, A describe “the 
same physics” since it is only the absolute value of the wave function that has physical 
meaning. If, however, the gauge ¢ needed to formally transform —A 4 to —A qj 1s more 
singular, then the corresponding operators are not necessarily unitary equivalent; the most 
interesting example here is the Aharonov-Bohm effect, to be discussed later on. 

For dimension d = 3, since there are only three independent nonzero components in B, 
one can compose a vector & by setting Bj = B23, Bz = B3,, B3 = Bi2 which is also called 
the magnetic field. 

In dimension d = 2 the magnetic field B is reduced to just one element, B = Bj2 = 
02A1 — 0;Az2. The same happens in the three-dimensional case, provided the field has 
constant direction, say, along the x3-axis, and here one can find a gauge wherein A = 
(A1(%1, X2), A2(%1, x2), 0). 

To define the magnetic Laplacian on a Riemannian manifold, it is convenient to consider 
the magnetic potential as a real 1-form A = )° A; dx; in local coordinates. The magnetic 
differential 


dy:uwdu+iuA 


maps functions to 1-forms, in other words, it defines a connection on the trivial linear 
bundle over M. Denoting the adjoint (with respect to the scalar product in the space of 
forms, (a, 6B) = f olka; Bug! 2 dx) differential as d*y (it maps 1-forms to functions), the 
magnetic Laplacian is defined as 


—Ay=daydy. (2.5) 


The magnetic field in this representation is a 2-form, B = dA, the curvature of the 
connection. On manifolds, even for regular magnetic potentials A,.A, the equality of 
the corresponding magnetic fields does not necessarily imply gauge equivalence of the 
corresponding operators: the topology of the manifold M may create obstacles for this. 
More exactly, if the first co-homology group of M is nontrivial, the equality dA = dA 
does not necessarily imply existence of a smooth function ¢ such that dé = A — A. In the 
cases when it is possible, in particular, in the Euclidean space for sufficiently regular mag- 
netic potential, one chooses the gauge in some convenient way, say to preserve a certain 
symmetry or to require d*.A = 0 — the so-called Coulomb gauge. 


Pauli operator. We consider the Pauli operator in the most important cases, i.e., d = 2 
and d = 3, and only for the Euclidean space. 
Let oj, j = 1,2, 3, be the Pauli matrices 


= 0 = 3) = = 
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satisfying the anticommutation relations ojo, + oxo; = 26;¢/, and let o = (01, 02, 03). 
For the magnetic potential A = (A,, A2, A3), the Pauli operator is defined as 


Pa=—(o-(V+iA))’=-V+iAP +0-B, Zo) 


in dimension 3, with obvious modification for dimension 2. 

Thus, the Pauli operator acts on two-component vector-valued functions and differs just 
by a matrix term o - B from the magnetic Laplacian. In dimension 2 as well as in dimen- 
sion 3 with magnetic field having constant direction, in the proper gauge the Pauli operator 
splits into the direct sum of two magnetic Schédinger operators 


Pa =Diag(—(V +iA)? + B). (2.7) 


In dimension 2 the Pauli operator admits another representation, a convenient factoriza- 
tion (temporarily, just formally), 


(010-0 
Pa=( 0 son Ce) 


where Q+ = (0; +iA,) +i(02 +iA2), provided the Coulomb gauge div A = 0 is chosen. 


Operators with electric potential. The operators defined above, with or without magnetic 
field, will be perturbed by an electric field. The electric potential, henceforth denoted by V, 
will be a real-valued measurable function or, possibly, a signed measure (in the latter case 
we also denote it by ). If V is a function, the differential operation will be denoted by 
Hay =H,+V (or Hay =H, — V), where H, is the magnetic Laplacian —A 4 (the 
usual Laplacian, if A = 0), or the Pauli operator P_4. We keep the same formal notation 
even in the case of V being a measure. 


3. Self-adjointness 


We discuss in this section the problem of defining operators, whose spectral properties 
are to be analyzed later. The most important observation here, as well as in other related 
problems is that the key instrument in spectral analysis of differential operators is given by 
functional inequalities. 


3.1. Essential self-adjointness 


The first task one encounters when studying the differential expressions described above is 
to associate to them some self-adjoint operators in proper Hilbert spaces, which includes 
defining directly or indirectly the domain of the operator and the action of the operator 
on the functions in this domain. The requirement of operators being self-adjoint follows 
from the condition of unitarity of the time evolution for the linear Schrédinger equation 
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i = Hv, where H is the operator in question. See the discussion in [112], Section X.1, 
on the physical meaning of self-adjointness. 

In very few cases one can approach this task directly. Thus, for the (negative) Lapla- 
cian in L7(IR@), the Fourier transform establishes self-adjointness of the operator on the 
domain D(— A) = H?(R2), the Sobolev space.” However, as soon as variable coefficients 
are present, such a direct approach does not work. 

In more or less regular situations, one considers, for a given differential expression H, 
a symmetric operator H° defined on some dense subspace D° in the Hilbert space L*. Most 
often, the space of compactly supported smooth functions, Y, serves as this initial domain. 
Then one applies the closure procedure. This means that one considers the closure of D° 
with respect to the norm ||u Ie = || Hull? + ||u\|?. The operator H® extends by continuity 
to this new domain, and may turn out to be self-adjoint there. In the affirmative case we say 
that the operator H° is essentially self-adjoint (on D°) and this means that there is just one 
“natural” self-adjoint operator corresponding to the differential operation under scrutiny. 

To implement this approach, one, first of all, needs that the coefficients of the opera- 
tor are sufficiently regular, so that the differential expression, when acting on compactly 
supported smooth functions, produces functions in L”. Thus, since the magnetic Laplacian 
can be represented as 


—A qu =—Au—2iA- Vu + (idivA+ |Al?)u, (3.1) 
the components A ; of the magnetic potential must satisfy (see [72]) 
dvAelLi. Aetna (3.2) 


and, additionally, 6 = curl A € Lee for the Pauli operator. The condition for the electric 
potential here is V € La 
can try considering a smaller initial domain D° of the operator, defining it on compactly 
supported smooth functions whose support does not touch the points of singularity of the 
coefficients. 

If the operator H® can be defined in this way, it is symmetric, and the next task is to 
prove its essential self-adjointness. In Section 4 we will discuss some methods one uses to 
show this as well as some classical and recent results. 

If the operator H° is not (proved to be) essentially self-adjoint, there may be an infinite 
set of self-adjoint extensions, the most interesting of which usually are realized by means 
of boundary conditions at singular points or at infinity. An extensive discussion of this 
topic can be found in [112], Section X.1. The important example we will consider in this 
chapter is the Aharonov-Bohm operator; see Sections 3.2 and 9.3. 

For more singular potentials one even cannot define the action of the initial operator H® 
on compactly supported smooth functions, since formally applying the differential oper- 
ation to such functions results in functions outside L* or even not functions. This means 
that the self-adjoint operator corresponding to the differential expression in question must 


For potentials having stronger but localized singularities, one 


2Breaking the tradition, we denote Sobolev spaces by the boldface letter H. The regular H is too overloaded in 
this field. 
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be somehow defined on nonsmooth functions. Being applied to the functions in the proper 
domain in the sense of distributions, the operation produces a sum of several distributions, 
such that being added together, strong singularities somehow cancel, resulting in a function 
that belongs to L?; say, for the Schrodinger operator —A + V with V not in Le , (or even 
a measure) one can consider the maximal operator defined on such functions u € L? that 
both — Au and Vu make sense as distributions and their sum belongs to L*. The maximal 
operator H™* thus defined, is, generally, not symmetric, and to obtain a self-adjoint oper- 
ator one has to restrict H™™* to some smaller domain. Since the description of the domain 
of the maximal operator is rather implicit, this approach is not very productive. 

As in many other cases, a perturbation approach is rather efficient here. If we are given 
an operator Ho which is already known to be essentially self-adjoint and we can show 
that the perturbation, V in our case, is in a certain sense weaker than Ho, then the proper 
perturbation theorem assures that the perturbed operator, Hp + V, is essentially self-adjoint 
on a certain domain, sometimes even describing explicitly the domain of the self-adjoint 
extension. 

The first basic result here is the Kato—Rellich theorem (see, e.g., [112], Theorem X.12). 


DEFINITION 3.1. Let S and T be densely defined operators in a Hilbert space. Suppose 
that D(S) D D(T) and, for certain positive numbers a, b and all elements in D(T), the 
inequality 


|| Sul? <al| Tull? + dllull? (3.3) 
holds or, what is equivalent, 
| Su] < al| Tul] + duh) (3.4) 


(with some other b). Then the operator S is called bounded with respect to T (or, shorter, 
T-bounded) with relative bound a. If for any positive a, a number b exists such that 
(3.4) holds, the operator S is called infinitesimally T -bounded. 


THEOREM 3.2 (Kato—Rellich (with addition by Wiist)). Let T be a self-adjoint operator. 
Suppose that the symmetric operator S is T-bounded with relative bound smaller than 1. 
Then the operator T + S is self-adjoint with D(T + S) =D(T) and essentially self-adjoint 
on any subspace where T is essentially self-adjoint. If the relative bound equals 1, the 
operator T + S is essentially self-adjoint on D(T). 


Thus, if the relative bound equals one, the theorem does not give a direct description of 
the domain of the self-adjoint extension of the operator T + S. 

As aclassical example demonstrating how the Kato—Rellich theorem works, we consider 
the Schrodinger operator in R? [61]. 


EXAMPLE 3.3 (Kato’s theorem). Suppose that V can be represented as a sum Vj + V2, 
where Vj, V> are real-valued functions, such that V; € L*, V2 € L© (henceforth this will 
be denoted by V € L? + L™). Then the operator —A + V is self-adjoint on H*(R*) and 
essentially self-adjoint on A(R). 
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The proof is based on an embedding theorem: For any a > 0 there exists a b such that 
I|ullze¢ <al|| Aull p2 + dllullz2 
foranyueD (R3) (see, e. g., [112], Theorem IX.28). This inequality, together with 
Vullp2 <WVillz2llulizce + Vallee lull z2. 


gives (3.4). So, the operator of multiplication by V is infinitesimally — A-bounded, and 
the Kato—Rellich theorem applies. This example hints that in more general situations, 
one needs more advanced functional inequalities (embedding theorems) to establish self- 
adjointness. 

The condition of the perturbation being relatively bounded is rather restrictive. In partic- 
ular, it is not fulfilled if the potential V tends to +00 or —oo at infinity. Important examples 
here are the harmonic oscillator V = c|x|? and the Stark potential (a constant electric field, 
V(x) =k- x). We will discuss the advanced methods for handling such situations in Sec- 
tion 4. 


3.2. Quadratic forms 


As it was mentioned above, the Schrodinger operator Hy in R@ can be defined on A(R) 
only provided V € Le : If the potential V has stronger local singularities, or especially, if 
it is a measure, not absolutely continuous with respect to the Lebesgue (or Riemannian) 
measure, one cannot apply the differential operation to arbitrary functions in Z (R?) and 
therefore the direct definition of the minimal operator (which we plan to extend further) 
encounters obstacles. The powerful method to handle such singular situations, as well as 
operators with magnetic fields, is the method of quadratic forms. 

First, some abstract theory. Having a self-adjoint operator H with domain )(H), un- 
der the condition that H is lower semibounded, (Hu, u) > —C]||u||* for some C > 0, 
one can consider the quadratic form, blu] = (Hu,u),u € D(A). The quadratic form 
h can be extended by continuity to the closure D(h) of D(H) with respect to the met- 
ric h[u] + (C + 1)||u||*. The resulting quadratic form will be denoted by QF (H), and 
its domain (h) also by Q(H). Thus the quadratic form can be constructed if the self- 
adjoint semibounded operator H is given. An important fact in operator theory is that the 
inverse construction also works. Having a quadratic form defined on some dense subspace, 
satisfying certain conditions specified below, one can, in a unique way, associate to it a self- 
adjoint operator. The conditions are the following. To justify the name “quadratic form’, 
h must be positively homogeneous, [tu] = |t|76[w]. The parallelogram identity must hold, 
blu + v] + b[u — v] = 2b[u] + 2b6[v]; the necessity of these conditions follows automati- 
cally from the relation h[u] = (Hu, u). Furthermore, the form must be lower semibounded 
and, the last but the hardest to check, it must be closed; the latter means that for a sequence 
of elements uj; € D(h), the relations ||u; — u|| > 0 and blu; — uz] > 0 imply u € D(b) 
and b[u; — u] — 0. If these conditions hold, a canonical procedure enables one to con- 
struct the unique self-adjoint operator H such that h = QF (#2). First, one has to construct 
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the sesquilinear form h[u, v] corresponding to the quadratic form, by means of the polar- 
ization identity, see, e.g., [155], Theorem 1.6, and secondly, one defines the domain of the 
operator H as consisting of such u € D(h) that the functional ¢,[v] = b[v, u] defined for 
v € D(h), is bounded in the basic Hilbert space. For such u, the action of the operator H 
on the element u is defined by means of identity (v, Hu) = b[v, u]; the element Hu exists 
and is unique, due to the Riesz representation theorem. 

Thus, in concrete situations, in order to define the operator having a quadratic form, 
one has to prove that the quadratic form is semibounded and closed (homogeneity and 
the parallelogram identity usually can be verified immediately). However, the closedness 
condition can be relaxed. We say that the form °, defined on the dense linear set D(h°) 
is closable if for any sequence uj; € D(h°), ||; || + 0, the property lu; — uz] > 0 im- 
plies lu j] — 0. If the form is closable, one can consider, as we have done it with the 
form (Hu, u) above, the closure of D(h°) in the metric h[u] + C||u||? with proper C. The 
form h° extends there by continuity to a closed form h. Closability of a quadratic form is 
much easier to establish than closedness, however, in singular situations even this can be 
a hard technical task. We present here two examples; the first one shows how the proof of 
closability usually goes in simple cases, the second produces a form which is not closable. 
EXAMPLE 3.4. Let V > 1 be a real-valued function in Li (R%). Consider the form 
btu] = f(Vul? + Viul?)dx, with domain D(5°) = A(R“). Supposing that h°[u; — 
ux] — 0, we can deduce, from known completeness of the Sobolev space H! and the 
weighted space L?,, that the sequence uj converges to some Uj, in the Sobolev norm, as 
well as it converges to some U2 in the norm of Los At the same time, since uv; converges to 
zero in L”, there is a subsequence which converges to zero almost everywhere. Taking yet 
another subsequence, we find that it converges to U2 almost everywhere, whence U2 = 0. 
Finally, convergence in H! implies convergence in L7, so uj > U, in L? and therefore 
U; =0. In conclusion, b°[u jl — 0 and therefore closability is proved. 


The crucial point in the reasoning above was the possibility of separating the terms in 
the form h° and therefore enabling one to use already known completeness of Sobolev and 
weighted L* spaces. This trick does not go through if we drop the condition of positivity 
of the potential V. We will see later how one handles this case. 

Now, the second example. 


EXAMPLE 3.5. Let §°[u] = |u(xo)|?, (6°) = D(R®), where xo is some fixed point 
in R¢. Fix some function ¢ € A(R%), such that ¢(0) = 1. Consider the sequence 
uj (x) = $(j(x — Xo)). This sequence converges to zero in i [uj — ux] = 0, however 
blu jl ~~ 0, and therefore the form is not closable. 


The method of forms enables one to construct certain special self-adjoint extensions 
of symmetric semibounded operators. Having such an operator H° with domain D(H°), 
one considers the form fu] = (Hu, u) with domain D(h°) = D(H°). This form is auto- 
matically closable (see, for example, [112], Theorem X.23, and [13]) and by closing the 
form and then finding the corresponding self-adjoint operator, we obtain the self-adjoint 
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operator which is called the Friedrichs extension of the symmetric operator H°. Quite of- 
ten (but not always) this extension turns out to be the most physically reasonable of all 
extensions. It is the absence of the Friedrichs extension that is one of the serious obstacles 
in the study of nonsemibounded operators, for example, Dirac and Maxwell operators. 

When considering the magnetic Laplacian and Pauli operators without electric potential, 
the quadratic forms used to define the operators are respectively 


ill = ff 90+ idul ax (3.5) 
and 
poll = ff Jo-(7u-+idwP ax (3.6) 


defined on the initial domain P(R®). These expressions are obtained by formal integration 
by parts in quadratic forms of the magnetic Laplacian and Pauli operators described in Sec- 
tion 2. If the magnetic field is sufficiently regular, so that the minimal symmetric operators 
can be defined on A(R“), these forms, after closure, produce the same self-adjoint opera- 
tors as the ones obtained above by means of the procedure of closing symmetric operators. 

If, however, these regularity conditions are broken, it is the quadratic forms (3.5) 
and (3.6) that must be used directly to define the operator. The conditions on the forms 
can be considerably relaxed. It suffices that the components A; of the magnetic field be- 
long locally to L?; this is the natural requirement for the forms to be defined on A(R?). 
It is rather easy (however, involving some technical tricks) to prove that for such magnetic 
potentials the forms (3.5) and (3.6) are closable (see, for example, [136]) and therefore de- 
fine self-adjoint operators. The same proof applies to the case of operators on Riemannian 
manifolds, with the form (3.5) modified accordingly [20]. In the case of more singular mag- 
netic potentials, one chooses the same expression for the form, but with different domain. 
For example, for the Aharonov-Bohm magnetic potential in R? [5], 


Ala, x2) = a(x, ar), r= (x2 4.3), (3.7) 


which does not belong to Ee one may consider, as the domain of the quadratic form, the 
subspace Y (R? \ {0}), which produces a self-adjoint operator, denoted — A apg, identical to 
the Friedrichs extension of the symmetric operator defined on the same domain. Alterna- 
tively, as a maximal domain for the quadratic form, one may take such functions u € L? 
for which (Vu +iAu) € L*. This procedure generates another self-adjoint operator. In 
fact, there is a four-parameter family of self-adjoint operators corresponding to the same 
differential expression, and many of them have physical sense; see, e.g., the discussion in 
[3,122,148]. 

As soon as the electric potential V is present, some additional perturbational reasoning 
must be used. Example 3.4 shows how to handle the case of a positive potential, but it is 
more convenient to give an abstract formulation, including, among others, the following 
case. 
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PROPOSITION 3.6. Let the semibounded forms j[u] with domains D(bj), j = 1,2, 
be closable, and let D(6,) 1 D(z) be dense. Then the form 6 = bh, + h2 with domain 
D(h1) AN D(h2) is closable. 


PROOF. Since both forms §; are semibounded, for a sequence uz € D(b1) MN D(b2) the 
relation h[ux — u;] + 0 implies  ;[ux — ui] — 0, and therefore, closability of h; implies 
that h j[ux] — 0 and, finally, b[u,] — 0. 


For the Schrédinger or Pauli operators with lower semibounded electric potential V this 
fact enables one to define the self-adjoint operator provided V € pee If V is even more 
singular, i.e., it is a measure p including a singular component, the form [ |u|" p (dx) is not 
closable on Y (it can be shown similarly to Example 3.5), and this limits the applicability 
of the proposition. 

In order to handle such singular situations, one has to modify Proposition 3.6 in the 
following way. Having a closable form t, defined on (t), we say that the form s, not 
necessarily semibounded, defined on an dense set D(s) C D(t) is closable with respect 
to tif for any sequence uz € D(s), the relations ||ux|| > 0, tlu,] > 0 and s[uxz — uj] > 0, 
k,1 > ww, imply s[u,] — 0. In particular, if the form s is bounded with respect to t, which 
means that |s[u]| < at[u] + bl|u||?, u € D(s), it is automatically closable with respect to t. 
This notion enables one to establish a perturbation criterion for closedness of quadratic 
forms, which generalizes the KLMN theorem (see [112], Theorem X.17). 


THEOREM 3.7 (KLMN). Let t with domain D(t) be a semibounded closable quadratic 
form; let the form s be closable with respect to t and, moreover, assume that 


s[u] > —at{u] — bljul|? (3.8) 


holds for some a < | and some b, for all u € D(t). Then the form t+ is semibounded and 
closable on D(), and thus defines a unique self-adjoint operator. 


The KLMN theorem in its usual formulation requires, in addition to (3.8), a similar 
estimate from above, which can be a too restrictive condition. 


PROOF OF THEOREM 3.7. One can just repeat the reasoning in the proof of KLMN the- 
orem in [112]. In fact, the estimate (3.8) implies that the form t + s is semibounded from 
below and that 


(t+s)[u] > (1 —a)t{u] — bljull’. (3.9) 
So, if we have a sequence ux such that ||ux|| > 0 and (t+ s)[uz — uj] > 0, (3.9) gives 


us that t[uz — uj] > 0. Now, since tis closable, t[u;] — 0 and, finally, relative closability 
of s implies that s[u;,] > 0. 


In Section 5 we will discuss some recent results concerning finding concrete analytical 
conditions for relative closedness and for estimates of the form (3.8). Here we just give a 
simple example. 
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EXAMPLE 3.8. Letd >3,VeL! 


isc (R7), and let its negative part V_ belong to L¢/? (R¢). 
Then the form 


bylu] =f (ivur + Vul*) dx (3.10) 
is semibounded and closable on Y and thus defines a unique self-adjoint operator. 


The main analytical fact in the study of this example is the Sobolev inequality (see, e.g., 
[91,112]), viz. 


2/4 d 
[ Ivulrdx > Cul f wi? dr) foru< F(R); q =. (3.11) 
R¢ R¢ 


Fix some K such that C4 _ K)_)42 dx < (2Cq)— 4/2. Then, using that V > —K — 
(V — K)_, the Hélder inequality and the Sobolev inequality, in this order, yield 


[i viwPax > Kitz, — fy — KluP ax 
R¢ Rd 


-Kiutis—(f, ((V—K)_)“"d ax) “(f,tetax) 


1 
—K ull}. - sf, |Vul? dx. 


Thus one of the hypotheses of Theorem 3.7 is satisfied. To check relative closedness is now 
easy. 

Finally, we compare the conditions imposed on V by the Kato—Rellich theorem and by 
the quadratic form method in the case of dimension d = 3. The Kato—Rellich approach, 
see Example 3.3, requires that the potential belongs to L? + L®. On the other hand, the 
quadratic form definition can be applied provided V € See with V_ € L7/*. Thus the 
restrictions on the growth of the potential and on the strength of singularities are both 
considerably relaxed. On the other hand, the quadratic form approach gives a rather implicit 
description of the domain of the self-adjoint operator and of the action of the operator on 
the functions in this domain. 

In the next example we present a perturbation which is not closable and which is not 
bounded with respect to the leading form but, nevertheless, is closable with respect to the 
leading term, and thus the Schrédinger operator can be defined. 


EXAMPLE 3.9. Let d = 1 and t[u = fp \u’|? dx, Gaede = J(R'). Define the measure p 
on the line, p = >-, n?5(x —n). ie the form s[u =f |u|* dp is closable with respect 
to t. Since it is semibounded, the sum t+ s defines a baa operator in L?(R!), which 
is natural to associate to the differential operation —d*/dx? + p. 
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It is easy to show that the form s is not closable in L*; just repeat the construction in 
Example 3.5. To prove that it is closable with respect to t, we use the inequality |u(xo)|? < 
f Ju’ > dx + f |u|? dx, u € A(R!) (the easiest way to prove it is to apply to the right-hand 
side of 


x 
Juco)? =2 f " gnu) dex, 
—0oo 


the Cauchy—Schwartz inequality). Therefore, having a sequence u;, such that ||; || > 0, 
t(u;] — 0 and s[u; — ux] — 0, we can verify that u;(n) — 0 for each n. Denote by U; 
the sequence nu j;(n),n € Z. Since s[uj; — ux] > 0, Uj is a Cauchy sequence in 17, and 
therefore it converges in 1? to some Up, s[u ; — uo] — 0. It follows that uj; (7) > uo(n) for 
all n and therefore uo(n) = 0, whence s[u;] > 0. 

In Section 5.2 we discuss general closability conditions. 

When we pass to operators with magnetic fields, it is again certain inequalities that 
play a crucial part. The main principle is that the presence of the magnetic field for the 
Schrédinger operator improves the crucial estimates. The most simple realization of this 
diamagneticity principle is the “weak diamagnetic inequality”’. 

PROPOSITION 3.10. If A€ L?2,.(R¢) and u € A(R®), then 


loc 


i Iu iui de> [ |Vlul|° dx. (3.12) 
R¢ R¢ 


The short proof of (3.12) can be found in [133] (see also [138], p. 2). It follows 
from (3.12), in particular, that if a form is |u|" p(dx) for some (signed) measure p (or, 
for a usual potential V(x), the form A \u|?V dx) is relatively bounded with certain bound 
or relatively closed with respect to the form f |Vu |? dx, the same is true with respect to the 
magnetic Dirichlet form. Thus, if for some electric potential, the self-adjoint extension can 
be constructed by the quadratic form method for the nonmagnetic Schrédinger operator, it 
can be constructed for the magnetic Schr6dinger operator as well. In fact, a much stronger 
version of the diamagnetic inequality can be proved (see Section 9.2), and in Section 9.5 
we will show its applications in spectral theory. A much more hard task is to find out how 
the situation improves when the magnetic field is being switched on. We discuss some 
recent results in Section 9.4. 

For the Pauli operator, even the weak version of the diamagnetic inequality does not 
hold. The most direct way to handle the problem of defining the self-adjoint extension here 
is using the relation (2.6), connecting the Pauli operator with the magnetic Schrédinger 
operator. Thus, in dimension 2, if we wish to define the Pauli operator with magnetic 
potential A, magnetic field B and electric field V, it is sufficient to solve this problem for 
the magnetic Schrédinger operator with electric potentials V + B and V — B (recall that 
here the magnetic field has only two nonzero components, +B). In the three-dimensional 
case one can consider operators with electric field V + Bz, where By are the eigenvalues 
of the matrix o - B. A deeper analysis of the interaction of the electric and magnetic fields 
gives more exact results, and we present some of them in Section 6.4. 
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For the case when no electric potential is present, there is a more direct way of under- 
standing how the quadratic form method for defining operators works. 

For the magnetic Laplacian —A_,4 on a manifold M, with magnetic potential A belong- 
ing to Ee we can consider the magnetic gradient V_4 as an operator acting from some 
space 09 of smooth sections of the trivial linear bundle to Le , sections of the bundle of 
1-forms. One can show that such an operator is closable, and we denote its closure by 
V.A(00). The domain 09 can be chosen, generally, in different ways. In particular, we can 
take 09 as Y, and this gives us the minimal operator va. On the other hand, one might 
have taken as 09 the space of all smooth functions u € L? on M such that V_4u € L?, the 
corresponding closure being the maximal operator Ma Whatever domain 09 is cho- 
sen, the process of closing the operator V.4 is the same as the process of closing the 
quadratic form b[u] = f |V.au|* dx = (Vu, V.4u); it is the completion of 09 with re- 
spect to the same metric. Thus, the operator corresponding to the closure of the quadratic 
form h[u] is the same as the operator A.4(09) = V_4(00)* V.4(0o), and the latter operator 
is automatically self-adjoint. Without magnetic field, since every function in the maxi- 
mal domain H! can be approximated in H! by finitely supported functions, the maximal 
and minimal quadratic forms and therefore the maximal and minimal operators coincide. 
A similar approximation approach works also for the magnetic operator in the Euclidean 
space [29,136]. Here, however, certain additional technicalities occur, since a priori it is 
not even clear that bounded functions form a dense set in the maximal domain, and this 
boundedness is important for approximating functions in this maximal domain by cut-offs 
with compact supports. Here the diamagnetic inequality (see Section 9.2) is crucial. For 
general Riemannian manifolds the equality of minimal and maximal quadratic forms is 
still an open question. 

The representation (2.8) enables one to use the same reasoning for the Pauli operator 
in R?. On some space 00 of 2-component smooth functions u = (u,, u_)' on R* consider 
the first-order operator O(u,,u—)' =(Q_u_, Q,u4)'. The closure of this operator, as 
before, produces the closed operator Q = Q(00), with domain coinciding with the domain 
of the closure of the quadratic form || Qu||* defined originally on 09. Thus the Pauli opera- 
tor can be defined as P_4 = P.4(ho0) = Q* Q, which is automatically self-adjoint. There is 
no diamagnetic inequality for the Pauli operator, so one must not expect that without addi- 
tional conditions imposed on the magnetic potential, the maximal operator coincides with 
the minimal one. This is surely not the case for very singular magnetic fields, for example, 
the Aharonov-Bohm one; see Section 9.3. 

In dimension 3 there is no analogy of the factorization (2.8) of the Pauli operator. Proba- 
bly, the most natural way to construct the self-adjoint operator is to consider it as the square 
of the self-adjoint Dirac operator D = o - (V +A), thus corresponding to the quadratic 
form di lo -(V +iA)u|? dx. In this setting one must use the fact that for A € Le the Dirac 
operator is essentially self-adjoint on F (see, e.g., [51,149], wherein it was proved for 
smooth magnetic field, but the reasoning works for A € Lee as well [129]). So, the Pauli 
operator is the square of the self-adjoint Dirac operator, and this definition coincides with 
the quadratic form approach. Note that the same reasoning gives a self-adjoint extension 
for the Pauli operator in dimension 2. 
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4. Essential self-adjointness 


We discuss here the methods for proving self-adjointness of Schrédinger-type operators 
and present some recent results on this topic. 


4.1. Evolution equation approach 


Having a symmetric densely defined operator H, with domain D(H), it is rather un- 
practical to try to prove essential self-adjointness of H by directly using the definition 
D(H) = D(H*), since, generally, it is rather hard to find an explicit description of D(A) 
and, especially, of O(H%). In the case (we are interested in) when the leading term of H 
is a second-order elliptic differential operator with smooth coefficients and the lower-order 
terms are not too singular, locally the domains D(H ) and (H%*) coincide, they consist of 
functions in H;... 

It is the behavior at infinity, or at singular points which may distinguish between these 
domains, and it is far from being easy to describe explicitly such “boundary conditions”. 
Thus, probably, the technically easiest approach to proving essential self-adjointness is 
based on the analysis of Cauchy problems for evolution equations related to H and H*, 
since it is often only local effects that are important here. The following exposition follows 
essentially the one in [128], where one can find further details. 

On the abstract level, the relation between self-adjointness and evolution equations is 
explained by the following statement, due to Povzner [107] (the abstract version is found 
in [12], p. 388). 


PROPOSITION 4.1. Let H be a (lower) semibounded densely defined symmetric operator. 
Suppose that the abstract wave equation 


vy" =—-H*y, wO)=u0, WO) =u1; uo, u1 € D(A), (4.1) 


has a unique solution in D(A“); here derivatives are understood in the strong sense. Then 
the operator H is essentially self-adjoint. 


The idea of the proof is as follows. If H is not essentially self-adjoint, then it has at least 
two different self-adjoint extensions, H ) and H®), which both are restrictions of H*. For 
each extension, the solution of (4.1) exists, and is given by the formula 


: ; sinv HW t 
w(t) =cos Vv AY) tug + Saar (4.2) 
AY 


(the choice of the square root does not matter because both functions cos(At) and sin(At)/A 
are even). The difference of solutions in (4.2) gives a nonzero solution of (4.1), thus unique- 
ness is broken. 

Proposition 4.1 can be modified in different ways. For instance, it is possible to re- 
place the abstract wave equation (4.1) by the abstract heat equation yw’ = —H*y. Even 
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the semiboundedness condition can be dropped, being replaced, in fact, by the equal- 
ity of deficiency indices of H (otherwise the operator surely cannot be essentially self- 
adjoint); in this case, uniqueness is required for the abstract Schrédinger evolution equation 
w’ =iH*w. The proofs follow the reasoning in Proposition 4.1. Further generalizations al- 
low the derivatives in the evolution equations to be understood in the weak sense, etc. 

It is, nevertheless, the wave equation approach which is most efficient for proving es- 
sential self-adjointness on Y(M) of second-order elliptic operators on a manifold M. Asa 
matter of fact, in order to prove uniqueness of (4.1), it is not necessary to know H™ since, 
due to Holmgren’s principle, this uniqueness follows from the solvability of the Cauchy 
problem for the adjoint equation 


wv" =Hy, WO) =u0, WO) =u1, v0, 41 € D(H). (4.3) 


The latter solvability can be established by means of the finite propagation speed property 
for hyperbolic equations. In fact, if initial conditions for the hyperbolic equation are com- 
pactly supported, the solution exists, and the support of the solution is controlled by the 
eigenvalues of the matrix of leading coefficients of the operator. So, if these coefficients 
ensure that the support of the solution is compact for all ¢ > 0, this solution will surely 
belong to D(H). This idea is due to Povzner [107]; it was later rediscovered and used in 
geometrical situations by Chernoff [25]. 

In particular, if the leading term is the Laplace—Beltrami operator on the manifold M 
then the propagation of solutions is described by geodesic distance. Therefore, if any geo- 
desic on the manifold can be indefinitely continued — such manifolds are called geodesi- 
cally complete — then the reasoning above establishes essential self-adjointness. Moreover, 
lower-order terms can be added, as long as they do not destroy two crucial features required 
by this approach: they do not influence propagation of solutions, and semiboundedness 
from below must be kept. Shubin has established the following theorem [128]. 


THEOREM 4.2. Let M be a complete Riemannian manifold and let H be a second-order 
symmetric operator of the form 


H=-A, +L, (4.4) 


where Ag is the Laplace—Beltrami operator and L is a differential operator of order not 
greater than one, with smooth coefficients. Suppose that H is semibounded from below 
on Y(M). Then H is essentially self-adjoint on Z(M). 


Thus, in the case of the standard Schrédinger operator —A + V, with V ¢ C%, The- 
orem 4.2 establishes essential self-adjointness of the minimal operator as soon as it is 
bounded from below, or, what is equivalent, as soon as 


-| ViuPdx < f IuPax +c f |u|?dx, ue D(M). (4.5) 
M M M 
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Thus, any progress in extending conditions for the inequality (4.5) automatically leads 
to new self-adjointness conditions. In Section 5 we discuss recent achievements on such 
estimates. 

The local smoothness condition on the potential can be considerably relaxed. In fact, this 
condition is only needed in order to establish local properties of the domain of the operator, 
Le., that u € ie. and —Au+ Vue Le. imply u € Hy. this would justify the reasoning 
above on local coincidence of domains of H and H*. Following this direction, the regular- 
ity conditions on V were gradually weakened up to V+ € ies Ve Le with p = 2 for 
d <3, p>2 ford =4 and p=d/2 for d [5 (see, for details, [112] for the Schrodinger 
operator in IR@ and [20] for operators on Riemannian manifolds). The condition on V1 is 
sharp, the condition on V_ can be a little bit sharpened, being formulated in terms of lo- 
cal Stummel classes (see, again, [112]). Further weakening of these conditions consists in 


expressing them not in terms of spaces but rather by means of functional inequalities [20]: 
for any compact K C M there exist ax < 1 and Cx, such that 


i |V_[ul?dx <axAgullzagy) + Cxllullrgy, “€ FW). (4.6) 
K 


However, in practice, all these results are almost sharp: in the example considered in [112], 
page 172, V(x) = —a|x|~7, where the potential just marginally fails to get into the classes 
above, for d > 5, self-adjointness fails for @ > ag. Here one can satisfy (4.6) for any 
ax > 1, by choosing a sufficiently close to ag. 

Results on self-adjointness for semibounded operators were preceded by weaker state- 
ments, where semibounded potentials were involved (see, e.g., [62]). 

The condition of the manifold to be complete cannot be dropped, even for the Euclidean 
space with a nonstandard metric. Examples were constructed (see, e.g., [151]) of elliptic 
operators of the form — }° 0;g jx(x) dx with matrices gj, which are not essentially self- 
adjoint on Z(R7), due to the fact that the coefficients 8 jk(x) grow very fast at infinity, thus 
forcing the propagation speed for solutions of the hyperbolic equation to grow at infinity in 
such a way that geodesics reach infinity in a finite time. This can, however, happen only in 
dimensions higher than 2. It was shown by Maz’ya [90] (see also [91]) that in dimensions 
1 or 2 this cannot happen, and thus any uniformly elliptic operator in divergence form is 
essentially self-adjoint on A(R®), d = 1,2. 

Returning to the Schrédinger operator in R¢, note that if the potential V is lower semi- 
bounded, even the domain of the self-adjoint operator H* = H can be described explicitly, 
provided some extra conditions are imposed on V, roughly forbidding V to change too fast 
on a finite distance. So, if, for simplicity, V >1, Ve Lise and 


V(x) 
Ee On Se 1, 4.7 
VO) |x — y| (4.7) 


then D(H) =H? Nn Bee in other words, —Au + Vu € L? and u € L* imply that both 
Au and Vu are in L?. This property for operators containing several terms is called 
separability. The result above was obtained in [117]. More general (but more complicated) 
conditions for separability can be found in [92]. 
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4.2. Nonsemibounded operators 


Suppose that the potential V tends to —oo at infinity, at least in some directions. This looks 
like a rather exotic case, from the first glance. However, some important physical models, 
including the (Stark) Hamiltonian with a constant electric field (thus a linear potential) get 
into this category. Potentials like V(x) = —A]x|? arise also in the semiclassical analysis 
near points of local maximum of the electric potential. In such cases the minimal operator 
usually turns out to be not semibounded, and Proposition 4.1 cannot be applied, at least 
directly (see, however, an ingenious trick of Kato, [62]). The Schrédinger equation version 
of this approach is hard to use as well, since the finite propagation speed property is ab- 
sent here. Thus the problem of proving essential self-adjointness presents a considerable 
mathematical challenge, and much work has been done here. 
So, consider, first in the Euclidean space, the Schrodinger operator 


Hyu=—Au+Vu, ue F(R‘), (4.8) 


with V — —oo at infinity. Such an operator is not semibounded, but the involution ut> u 
maps isomorphically the deficiency subspace Ker(Hj, + iJ) onto Ker(Hy, — iJ), thus 
Hy has equal deficiency numbers and therefore it has self-adjoint extensions. Following 
the physical intuition, one must expect that the behavior of integral curves of the complete 
classical Hamiltonian H(p, q) = p*+V(q), (p,q) € R¢ x R4, i.e., solutions of the system 
q' =90H(p,q)/dap, p' =—dH(p,q)/dq, must determine self-adjointness. If these trajec- 
tories can be infinitely continued (the system is classically complete), the operator does not 
need boundary conditions at infinity and therefore must be essentially self-adjoint; if some 
trajectories reach infinity in a finite time, one has to describe what happens with the system 
after this time, and this means that some boundary conditions must be specified at infinity, 
and the choice of these conditions determines the self-adjoint extension. In this case, the 
intuition turns out to be essentially correct, provided one imposes certain regularity condi- 
tions. Without regularity, classical and quantum completeness are not necessarily related 
even in the one-dimensional case, as discussed in, e.g., [112], Appendix to X.1. 

The following approach is used to establish essential self-adjointness of H. This prop- 
erty is equivalent to symmetricity of H*. Hence, it suffices to prove that, for u, v in the 
domain of the maximal operator, the equality 


(Hu, v) = | (wuo+ V(x)u(x)v(x)) dx, (4.9) 


holds, i.e., integration by parts does not produce out-of-integral terms. (Note that one does 
not expect that integrals of separate terms in (4.9) are finite.) Assuming that local regularity 
conditions on V are fulfilled, one can hope that for a ball Br with radius R, 


| aucoweoar + f VuVvdx > 0, (4.10) 
Br Br 
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as R — ov, at least along some sequence. This, in fact, can be proved, provided that 
V(x) can be minorized by a regular function depending only on r = |x| and tending to —oo 
not too fast, i.e., 


Vax)2-Q(r), (4.11) 


where Q(r) is a positive nondecreasing function on the semiaxis, obeying 


ie Q(r)7'/* dr = 00. (4.12) 
0 


This essential self-adjointness result by Titchmarsh and Sears (see [13] for a modern expo- 
sition), shows that if, e.g., V(x) = —(1 + |x|?)%/? the condition (4.12) is satisfied exactly 
for a < 2. Separation of variables enables one to study self-adjointness for this operator di- 
rectly and it turns out that, in fact, if ~ > 2 then the operator is not essentially self-adjoint, 
so the condition is relatively precise. Also classical completeness takes place exactly for 
a < 2. More elaborate reasoning enables one to replace (4.11) by a similar estimate ex- 
pressed in the sense of quadratic forms, 


(Hu, u) > —45(Au,u) —(Q(r)u, u), ue F(R‘), (4.13) 


for some 6 € (0, 1), thus admitting potentials V which are not even locally bounded from 
below (see [115]). It is this generalization that establishes self-adjointness for Hamiltonians 
arising in quantum mechanics, with negative potentials having strong local singularities. 

Returning to (4.9), note that, in fact, one cannot guarantee that even under the conditions 
(4.11) and (4.12), integrals of separate terms in (4.9) are finite. Separability, mentioned at 
the end of Section 4.1, does not take place even for quadratic forms. What one can prove, 
nevertheless, and it is an important step in the proof of Titchmarsh—Sears-type theorems, 
is that the integral Ig[u] = e |Vu(x)|7/O(2|x|) dx is finite for u € D(H). 

This observation turns out to be also essential in finding proper versions of this result for 
Schrédinger operators on manifolds. In fact, condition (4.12) means also that the Euclidean 
space R?, equipped with the modified metric Bik = jk Q(|x|)~! is complete, so finiteness 
of Ig[u] is just the finiteness of the Dirichlet integral with respect to this metric. 

In the most general setting, essential self-adjointness of nonnecessarily semibounded 
operators on manifolds was established recently by Oleinik [103]. 


THEOREM 4.3. Let M be a complete Riemannian manifold, V € Le. and let the local 
condition (4.6) be satisfied. Let Q(x) > 0 be a function on M such that Q~'/* is globally 
Lipschitz on M. Assume that the Schrodinger operator can be estimated from below by —Q 
in the sense of quadratic forms (as in (4.13)) and, moreover, assume that 


[otas = 00 (4.14) 


along any curve in M, going to infinity, i.e., leaving every compact set. Then the minimal 
operator H = —A, + V is essentially self-adjoint on Z(M). 
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Note that the condition (4.14) simply means that the manifold (M/, g) is complete with 
the metric Q~!g. 

The proof in [103] (see also [20] for further generalizations and general discussion) 
consists in an elaborate localization: one proves that, for a properly chosen sequence ¢y, 
of cut-off Lipschitz functions on M, an approximate integration by parts can be performed 
for u,v € D(A%), ie., the difference 


(gnu, H*v) —(H*u, dnv) 


can be controlled and tends to zero as the support of ¢, extends. This proves that 
H* is symmetric. In the process of this localization, the most technically involved step 
consists in estimating integrals containing |u|* and |Vu|? with weights via integrals of 
|Au|* and |Hu|?. 

Note, finally, that the cases of linear or negative quadratic potentials, mentioned in the 
beginning of this subsection, are dealt with by the most simple versions of Theorem 4.3. 


4.3. Operators with magnetic fields 


For the magnetic Schrédinger operator the traditional way of establishing self-adjointness 
(as well as many other questions) is using inequalities in some way expressing the main 
property — diamagneticity. The concrete inequality used in self-adjointness studies is the 
Kato inequality, established first in [62] for the Laplacian and then extended to the mag- 
netic Laplacian in [53]. We present the distributional form of Kato’s inequality derived 
in [20]. A distribution v is called positive if (v, @) > 0 for any nonnegative test function @ 
(this definition concerns both the Euclidean space and an arbitrary manifold). 


PROPOSITION 4.4 (Kato’s inequality). Let A be a smooth magnetic potential on the 
Riemannian manifold M and let A, be the corresponding magnetic Laplacian defined 
in (2.2). Then, for any u € Lie such that A qu € Eee in the sense of distributions, one has 


Alu| <K(signuA qu), (4.15) 


where A is the Laplacian on M and sign(u(x)) is defined as u(x)/|u(x)| at the points 
where u 4 0 and zero elsewhere. 


The inequality is proved first for smooth functions u for which one directly establishes 
ucAue < RUA YU), Ug = (\u|? + ¢62y1/2, and passes to the limit ¢ — 0, and then it extends 
to any u by means of mollifiers. In [20] an even more general form of the Kato inequality is 
established, valid for magnetic Laplacians acting on sections of Hermitian vector bundles 
over M. The conditions on the magnetic potential can be relaxed. The reasoning explained 
above still works for the continuously differentiable A. 

Having (4.15) at disposal, one can follow the proof of essential self-adjointness of the 
nonmagnetic operator, where, in the process of localization, integrals of the function |u| 
with different weight were estimated by integrals of Au. Due to Kato’s inequality, these 
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estimates are still valid, with the Laplacian replaced by the magnetic Laplacian. As for 
estimates of integrals containing the magnetic gradient of u, it is evaluated via the usual 
gradient, with the help of (3.12). This proves that H* is symmetric. 

This way of reasoning gives, in particular, the following self-adjointness condition ob- 
tained by Braverman, Milatovic and Shubin [20]. 


THEOREM 4.5. Suppose that the magnetic potential A on the manifold M is continuously 
differentiable and the electric potential satisfies the hypotheses of Theorem 4.3. Then the 
operator H., y is essentially self-adjoint on (M). 


The conditions on the magnetic potential in Theorem 4.5 can be relaxed. On a general 
manifold, it is sufficient to suppose that it is locally Lipschitz. Moreover, in the special case 
of the Euclidean space, with lower semibounded potential V, essential self-adjointness is 
proved as soon as the minimal operator is defined on JR), i.e., under conditions (3.2) 
(see [72]). 

Kato’s inequality can also be used to prove the semigroup form of the diamagnetic in- 
equality (see Theorem 9.2). It will be discussed later in relation to spectral estimates. 


Pauli operator. There are no special studies of essential self-adjointness of Pauli oper- 
ators (with or without electric potential) but a number of results can be obtained from 
the connection with the magnetic Schrédinger operator; see (2.6). In dimension 2, as well 
as in dimension 3, provided the magnetic field has constant direction, (2.7) reduces the 
self-adjointness problem for the Pauli operator P_4 + V to the same problem for two mag- 
netic Schrddinger operators with electric potentials, respectively, V + B. Thus the results 
above on the magnetic Schrédinger operator can be used. For general magnetic field one 
does not have such a decomposition and one has to study magnetic Schrédinger operators 
with matrix-valued potentials. Such a study was performed in [20], even in a more general 
setting, for Schrédinger-type operators in sections of Hermitian vector bundles over mani- 
folds. Self-adjointness conditions for Pauli operators can be extracted from [20] (however, 
no explicit formulations are given there). 


5. Quadratic forms estimates 


Now we return to the definition of the operators by means of quadratic forms. As it was 
mentioned above, the quadratic form definition requires considerably less regularity of the 
electric and magnetic potentials. In fact, they even do not have to be functions; certain 
classes of measures are allowed. There are several basic questions which we are going to 
address. First, for a nonnegative electric potential V, we discuss conditions under which 
the form [ |u| V dx is closable with respect to the form § of the unperturbed operator Ho. 
This enables one to use Theorem 3.7 to define the operator Hp + V by means of quadratic 
forms. 

Another group of questions deals with nonpositive potentials. The first problem here lies 
in finding conditions of boundedness of the quadratic form of the potential with respect to 
the unperturbed quadratic form, with control over the relative bound. Such estimates are 
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needed already when one studies the essential self-adjointness, see Theorem 4.2. For more 
singular potentials, this estimate is required by the KLMN theorem. A convenient case, 
frequent but not universal, is the infinitesimal form-boundedness, where one may avoid 
controlling constants. Infinitesimal form-boundedness is also closely related to relative 
compactness which is crucial in the question of finiteness or discreteness of the negative 
spectrum of the operator Hp + V. 

The above questions are classical in spectral theory, going back to the 1930s, but they 
continue to be of much interest up to today and the latest results, which may be considered 
as being final for the Schrddinger and magnetic Schrédinger operators, were obtained in 
the course of the last 3-4 years. 

Clearly, the natural next step would be to consider potentials with variable sign. Here 
the situation is not quite clear yet, however essential progress was achieved lately as well. 
Until quite recently, the analysis of such potentials was reduced to the consideration of 
positive and negative parts separately. This led to sufficient but nonnecessary conditions 
for the crucial inequalities to hold, and thus to conditions only sufficient for semibounded- 
ness of operators, discreteness of the whole or only negative spectrum. Lately new methods 
have been developed enabling one to take into account possible cancellation of influence 
of positive and negative parts of the potential. In the process even exact criteria for rel- 
ative boundedness, infinitesimal boundedness and compactness of the quadratic forms of 
the perturbation, were found, and this automatically produces new semiboundedness con- 
ditions and description of the spectrum for the perturbed operators. 

The progress in this field is mainly due to the developing of efficient methods in function 
theory, especially capacities and potentials. In the next section we present a short review 
of the necessary facts, for our special case of second-order operators. For details on the 
general cases, as well as for proofs, and further references, the reader is referred to the 
book by Maz’ ya [91], as well as [4,93] and the recent papers [65,95—97,152]. 


5.1. Capacities, potentials and functional classes 


Quite long ago it was noticed, probably, first by Wiener, that the Lebesgue measure is 
not sufficient to control fine effects for partial differential equations. It turned out that the 
notion of capacity provides one with the adequate instrument. In what follows, when we 
say that some quantities are equivalent, we mean that their ratio is bounded from above 
and from below by some constants depending only on the dimension d of the underlying 
space. 

Let F be acompact set in R@ and let G be an open set containing F’. Denote by St(F, G) 
the set of functions u € Y(G) such that u > 1 on F.. Then the Wiener capacity of F with 
respect to G is defined as 


cap(F, G) =inf{||Vull7o,4): we NF, G)}. (5.1) 


(G)" 
In the case when G coincides with R¢ , G is omitted from this notation. For d > 3, one 
always considers G = R¢, since for F being a subset in a cube Q, cap(F, Q) is equivalent 
to cap(F) for the concentric cube Q with twice as large sidelength. 
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Wiener capacity for d > 3 is equivalent to Riesz capacity, defined by 
inf{ || fllz2qay: R* f > lon FH, (5.2) 


where the Riesz kernel, R(|x|) = Cy|x|~¢t!, is the kernel of the integral operator 
(—A)7!/2 in L2(R¢). 
Another capacity, named after Bessel, is also needed, defined equivalently as 

Cap(F) = inf{||Vull7o gay + luli: we NEY}, (5.3) 
or 

inf{ IF U2 ¢gay: Gx f on F >0}; (5.4) 
where the Bessel kernel, 

B(|x|) = Calx|O-O? Katy 2(al), (5.5) 
K,, being the modified Bessel functions, is the integral kernel of the operator (1 — A)~!/? 
in L7(R?). 

Note that the Riesz and Bessel kernels have the same behavior at zero, while at infin- 
ity B(r) decays power-like, and R(r) decays exponentially. Evidently, cap(F’) < Cap(F). 
Bessel capacity is used first of all in the study of the space H!. Riesz capacity handles the 
case of the space h! (the homogeneous Sobolev space), the closure of A(R“) with respect 
to the metric ||Vu||*. The latter space is considered only for d > 3; otherwise it is not a 
space of functions. For such d, of course, H! C h!, and locally the spaces coincide. Among 
other properties of capacities, we mention the two of most importance for us. First, it is 
their relation to Lebesgue and Hausdorff measures. One has 

cap(F) > C(meas(F))'~7/", d>3. (5.6) 
Furthermore, for d > 3, all sets with finite Hausdorff measure of dimension d — 2 have zero 
capacity. For Bessel capacity this statement is correct also for the case of d = 2 provided 
the logarithmic Hausdorff measure of a set is finite. On the other hand, if the set has positive 
Hausdorff measure of dimension larger than d — 2, then it has positive capacity. 

Another property is related to convergence. We say that a sequence of Lipschitz func- 
tions converges to zero quasieverywhere with respect to Riesz or Bessel capacity if it con- 
verges everywhere with exception of some set having zero capacity. The property we need 
says that if a sequence of functions in J converges to zero in h!, resp. H', then one can 
select a subsequence converging quasieverywhere with respect to the corresponding capac- 
ity. 


5.2. Closability 


In this subsection we will consider perturbation of the Laplace (resp., magnetic Laplace or 
Pauli) operator by a lower semibounded quadratic form g,[u] = i |u|? do(x), where p isa 


Schrédinger operators with singular potentials 435 


Borel measure on R¢. The unperturbed form h is closable, so, according to Theorem 3.7, 
one has to check closability of g, with respect to §, all forms defined on Q(R?). We say 
that the measure p is absolutely continuous with respect to Cap if all sets with vanishing 
Bessel capacity have zero measure p. 


THEOREM 5.1. Let the measure p be absolutely continuous with respect to Cap. Then the 
form Gp is closable with respect to the forms of the Laplacian and the magnetic Laplacian, 
for the Laplace operator this condition on the measure is also necessary for closability. 

PROOF. We prove the sufficiency part. For a given magnetic field A € Le : 
by 6.4 the magnetic quadratic form (3.5) and by h the usual Dirichlet form, h[u] = ||Vul|?. 
Let un € J be a sequence such that 4 4[un] + ||u||?  O and assume it is a Cauchy se- 
quence with respect to the form g,. Consider the sequence uv, = |u,|. These functions are 
Lipschitz, and since ||v_| — |vm|| <|Un — Vm, they form a Cauchy sequence for gp. At the 
same time, due to (3.12), the sequence v, converges to zero in H!. Therefore it contains 
a subsequence converging to zero quasieverywhere and, due to the conditions imposed on 
the measure, almost everywhere with respect to measure p. Now, since this subsequence 
is a Cauchy sequence in L?, it must converge to zero in this space. The necessity proof is 
more cumbersome (see [91]). 


we denote 


Theorem 5.1 enables one to define self-adjoint Schrédinger and magnetic Schrodinger 
operators with a very wide class of measures as electric potentials. If such a measure is 
absolutely continuous with respect to Lebesgue measure, this situation (without magnetic 
field) is taken care of in Example 3.8. Now some singular measures are allowed, in par- 
ticular, supported on smooth surfaces of co-dimension one and absolutely continuous with 
respect to the surface measure, or, more generally, on sets having Hausdorff dimension 
larger than d — 2 and absolutely continuous with respect to the corresponding Hausdorff 
measure. In addition, one may, having a nonsemibounded potential, break it into the posi- 
tive and negative parts, add the positive part using the theorem, and then add the negative 
part, using other perturbation theorems. 

The reasoning above does not work for the Pauli operator, the main reason for this (as 
well as for many other questions concerning Pauli operators) being the absence of the 
diamagnetic inequality for the Pauli quadratic form. 


5.3. Relative boundedness 


As it can be seen above, the key instrument in establishing essential self-adjointness as 
well as in defining the operator by means of quadratic forms is given by inequalities of the 
form 


otal =| f weer) <Cihlu]+Collull?, we A(R*), (5.7) 


where h is the quadratic form of the unperturbed operator (Laplace, magnetic Laplace, etc., 
probably, containing some previously included perturbations). In many cases one needs 
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the constant C; in (5.7) to be smaller (or not larger) than 1. To trace the constants in 
inequalities may be a rather tedious job, but the task simplifies considerably if the form g, 
is infinitesimally form-bounded with respect to h, i.e., (5.7) holds for any positive C; = «, 
with C2, of course, depending on ¢. For the needs of spectral analysis, one should be able 
also to find conditions for the form g, to be compact with respect to h, meaning that any 
sequence u, bounded in L? and with respect to h contains a subsequence which converges 
with respect to g,. Below we present some results concerning these questions. 

Consider first the case of a nonnegative measure p. The easiest result of the form (5.7) 
follows directly from Hélder’s inequality and Sobolev’s embedding theorem. If one as- 
sumes that p is absolutely continuous with respect to Lebesgue measure, op (dx) = V(x) dx 
and for some K, the function (V — K)+ belongs to L’, where r = d/2 ford >3 andr > 1 
for d = 2, (5.7) holds for an arbitrarily small Cj, i.e., g is infinitesimally form-bounded 
with respect to h. The proof is essentially the same as in Example 3.8: if the condition 
above is satisfied then, by choosing a proper K, one can make the L’ norm of (V — K)+ ar- 
bitrarily small. The Holder inequality yields glu] < || V ||z" lula, q = 2r/(r — 1). Finally, 
the latter norm of u is estimated by h[u] + ||u||? according to the embedding theorem. 

Thus, for example, an arbitrary finite configuration of Coulomb potentials in R@, d >3, 
V=>0Z;/|x - x'J)| satisfies the above conditions. 

If the function V itself belongs to L”, r = d/2, d > 3, (5.7) holds even without the lower 
order term llulle >: 


[woven 


with Cy =cq||V||,</2 and the constant cg depending only on dimension; one just uses the 
Sobolev inequality (3.11) instead of the embedding theorem. 

These results are easy to use, but they do not cover the important case of potentials be- 
having like r~*, where r is the distance to some point in R@ or to a submanifold. Although 
this singularity is essentially stronger than the most interesting Coulomb case, it arises, for 
example, when one considers singular magnetic fields. At the same time, for V having the 
order r~7, the inequality of the form (5.7) and even (5.8) may hold, the best known case 
being the Hardy inequality, viz. 


<Ciblu], ue A(R‘), (5.8) 


—2),)2 (d— 2)? 2 1 d 
|x|7*|u| B= |Vul-dx, d>3,ueh'(R*). (5.9) 


Finding weights (and measures) which can replace |x|~? here is important for many ques- 
tions in spectral theory, in particular, for obtaining eigenvalue estimates. 

The criteria for estimates of the form (5.7) and (5.8) were obtained first in the 1960s 
by Maz’ya, in terms of capacity [89]. Later, several equivalent criteria were found. One 
can follow the development in the books [4,91,93] and a series of papers (we mention [95] 
in the first place). These results deal with a nonnegative measure p. Along with capacity, 
criteria for estimates can be expressed in terms of potentials of the measure. They are 
defined as J(¢) = R * pe (Riesz potential), and J(o) = B « pe (Bessel potential). Of course, 
certain local and global restrictions on these measures must be imposed in order that the 
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potentials are finite almost everywhere; see the aforementioned references for details and 
additional boundedness criteria. 


THEOREM 5.2 (Relative boundedness for nonnegative measures). Let p be a nonnegative 
Borel measure on R¢. 
(1) For d = 3 the following statements are equivalent, with equivalent constants 
Ci ; C2, C3: 
(a) the inequality f \u|*p(dx) < C,||Vull?, u € A(R), holds; 
(b) for every compact F C R¢, 


pP(F) < C2 cap(F); (5.10) 


(c) for every ball B, 


i (1(pp)) dx < C3p(B), (5.11) 


where pp is the restriction of p to B. 
(2) For d >2 the following statements are equivalent, with equivalent constants 
Ci, C2, C3: 
(a) the inequality | [ |u|? p(dx)| < Ci(|Vull? + llull?), we FRY), holds; 
(b) for every compact F C R¢, 


P(F) < Cz Cap(F); (5.12) 


(c) for every ball B, 


[ (100)? ax <cs00B). (5.13) 


REMARK 5.3. The words above, concerning “equivalent constants”, require an explana- 
tion. This expression means that if one of the equivalent statements is true, with some 
constant C;, then another statement is also true with some constant Cx, so that Cy < cC; 
for some c depending only on the dimension. Conversely, if the second condition holds 
with some Cx, the first one holds with some C p again C f; <cC,. The theorem does not 
declare that Cj = C fe Thus the statements of the theorem are equivalent as it concerns the 
inequalities involved, but still there is a gap in the size of constants. This remark concerns 
also all further results where equivalent constants are present. 


Thus, if for a given measure p¢ in (5.12) or (5.13) the constants C2 or C3 are sufficiently 
small, so that the constant C; is smaller than 1, the form f |u|* (dx) is bounded with 
respect to the form of the Laplacian with relative bound smaller than 1, and therefore one 
can apply the KLMN theorem to define the Schrédinger operator with “potential” —p. 

Since capacitory or potential terms are rather implicit, it is fairly hard to apply the above 
criteria directly. One can, however, extract more transparent sufficient conditions, using 
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estimates for capacity and potentials. For example, the estimate (5.6) of capacity from 
below by Lebesgue measure, gives a sufficient condition p(F) < C4Cap(F) for relative 
boundedness. 

In particular, let p(dx) = V(x)dx, V > 0. Denote by M(t) = M(t, V) the set 
{x: V(x) > t} and set m(t) = meas(M(t)). Then for a fixed y = meas(F), the largest 
possible value of p(F) is obtained when F = M(s), where s = sup{t: m(t) > y}. An easy 
calculation shows that if m(t) < Cot~4/* then 


p(M(s)) =— [rane < C7(meas(M(s)))' 7/7, 


Ss 


and therefore, o(F) < C7 meas(F yea tor any compact F. This, together with (5.6), 
gives the following sufficient condition for boundedness [91]. 


COROLLARY 5.4. Let p(dx) = V dx, V >0,d > 3, and meas(M(t, V)) < Cot—4/2. Then 
the estimate (5.8) holds with a constant equivalent to Cg. 

(Note that the functions V satisfying the above condition are said to belong to the 
“weak 14/2” space, denoted Face a 


When applying the KLMN theorem, and generally, establishing semiboundedness, we 
need not (5.8) but only (5.7) with C; < 1. Therefore the following condition is more con- 
venient to use, putting restrictions only on “large” values of V but not requiring any decay 
at infinity. It follows automatically from Corollary 5.4. 


COROLLARY 5.5. Let p(dx) = Vdx, V >0, d > 3, and assume that meas(M(t, V)) < 
Cot 4/2 for t > to. Then (5.7) holds, with C equivalent to Cg and some C2 depending 
on to. If the resulting C, is not greater than 1, the quadratic form ||Vul||* — ( V |u|? dx 
is lower semibounded on P(R¢). If Cy <1, this quadratic form defines a self-adjoint 
operator in L?(R¢). 


The general theorem can also be customized for measures supported on submanifolds or 
fractal sets, using the relation of capacity to Hausdorff measure. 

Due to the weak diamagnetic inequality (3.12), the conditions above immediately im- 
ply relative boundedness and, resp., semiboundedness of the forms for the magnetic 
Schrédinger operator. 

As it was mentioned above, if one can establish infinitesimal form-boundedness of the 
potential perturbation, one can handle the problem of defining the operator more comfort- 
ably, since one does not need to trace the values of the constants. As for the conditions 
of Corollary 5.5, infinitesimal form-boundedness obviously follows if one replaces there 
the inequality meas(M(t, V)) < Cet 4/2 by meas(M(t, V)) = o(t~4/"), t > oo. A recent 
criterion [97], similar to Theorem 5.2, can also be expressed in terms of capacities (for 
other terms, see [97], Theorem 4.1). 
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THEOREM 5.6. For a nonnegative measure p on R4,d > 2, infinitesimal form- 
boundedness of f |u|" p (dx) with respect to \|Vull* is equivalent to 


P(F) | 
Cap(F) 


lim sop F CR¢,diam(F) < s} =0. (5.14) 


5.4. Nonsign-definite weights 


In the case of nonsign-definite weights, relative boundedness conditions can, of course, be 
obtained from the sign-definite case. In fact, if we represent the measure p as the difference 
of two nonnegative measures, p = p+ — p_, and the measure p+ is closable with respect 
to the form ||Vu||?, then the boundedness with proper relative bound (infinitesimal bound- 
edness) of the form f |u|" p_ (dx) with respect to || Vul|? implies the same with respect to 
a larger form |Vull? + f |u|*04.(dx), and this, as before, leads to semiboundedness and 
closedness of the whole perturbed form. This, however, does not take into account an im- 
provement of situation which hopefully may happen if the influence of p, and of o_ cancel 
each other. It was only in 2002 that a new approach was developed capable of taking into 
account such cancellation. As a result, necessary and sufficient conditions were found for 
form-boundedness and infinitesimal form-boundedness [96]. 


THEOREM 5.7. Let p be a Borel measure on R¢. 

(1) For d > 3 the following are equivalent, with equivalent constants: 

(a) the inequality | f |u|? p(dx)| < Cy ||Vull?, ue AR*) holds; 

(b) there exists a vector field T = (I\,...,Iy) € if such that the quadratic 
form gr{u] = SOC Plul? dx satisfies the inequality gr{u] < C2||Vull?, u € 
Q(R*), and p = div T in the sense of distributions. 

(2) The form f |u|? p(dx) is bounded with equivalent constants (infinitesimally 
bounded ) with respect to ||Vul|*, d > 1, if and only if there exist a vector field 
Fr=(,...,la)€ ie and a function Io € Tae. such that the quadratic form 
(Tol +> [I°|?) |u|? dx is bounded (infinitesimally bounded) with respect to 
|| Vul|? and p = div + Ip in the sense of distributions. 


PROOF. In the expression 
fuuPawrac= f ucaiv ras, ue Y(R‘), 


we integrate by parts, obtaining 


[weaves 


1/2 
<2ivui(f wPireax) 


=2| [ xuvnras 
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and this explains the sufficiency part of the theorem. The “necessary” part is by far more 
delicate. It turns out that one can even get explicit expressions for JQ and I: 


r=-V(dl-A)'p, M=A—-A)'p, 


where (1 — A)7! p is understood in the sense of distributions or as the Bessel potential of 
order 2. 


In this way, the case of nonsign-definite potential is reduced to the case of a nonnegative 
potential, which is taken care of by Theorems 5.2 and 5.6. 

Again, by means of the weak diamagnetic inequality (3.12), the above theorem gives suf- 
ficient conditions for boundedness (infinitesimal boundedness) for the case when a mag- 
netic field is present. Necessary conditions for that case are unknown at the moment of 
writing. 


5.5. Relative compactness 


In the study of spectral properties of the Schrédinger operator the key role is played by 
compactness theorems. As it will be shown in the next section, questions of discreteness 
of the whole or negative spectrum as well as finiteness of the negative spectrum can be 
reduced to the relative compactness of corresponding forms. 

Generally, having a closable nonnegative form in the Hilbert space, we say that the 
form g is compact with respect to h if any sequence u,,, such that h[u,,] is bounded, contains 
a subsequence, convergent in the g-norm. 

In other way, this property is convenient to describe by means of the Birman—Schwinger 
operator Tg defined by the quadratic form g[u] in the Hilbert space D(h), equipped with 
the norm h[u] + ||u||? (see also Section A.10). In more details, using the sesquilinear forms 
corresponding to our quadratic forms, this means 


6175.54, v] =((H +1)! Ty gu, (H+ 1)!*v) = glu, v], (5.15) 


where #7 is the self-adjoint operator corresponding to the form h. Compactness of the 
form g with respect to h means that the operator Tg, is compact. If we return to our 
basic Hilbert space, setting (H + 1)!/*u = ¢, (H + 1)!/2v = w in (5.15), we find that the 
operator Ty 4 1s unitary equivalent to the operator Kg, there, defined by the relation 


(Kg.o%, ¥) =9[(H +1)7176, (H+ 171? yp). (5.16) 


The operator Kg y is just another useful variant of the Birman—Schwinger operator which 
is applied time after time in spectral analysis; see also Sections 6.2, 7.1 and A.10. 

In the particular case when H = —A and g = gp, the operator Kg 4, according to (5.16), 
is the integral operator with kernel 


Kas(r.y)= f B(x — 2|)B(ly — zl) (dz), (5.17) 
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where B is the Bessel kernel (5.5), the integral kernel for the operator (— A + 1)~!/2, When 
p = V dx, the operator Kg 4 can also be written as (H + 1/28 +1)7!/2, 

A number of spectral properties of the Schrédinger operator can be expressed in terms 
of the Birman—Schwinger operator. In particular, relative compactness of the form gp, is 
simply compactness of Ty) or Kg,y- 

Unlike boundedness, compactness conditions for forms in the whole space consist of 
two parts. Local conditions assure that the operator of the type (5.15) or (5.16) defined 
by the restriction of the measure p to any bounded ball is compact. Additionally, one has 
to require some sort of decay at infinity, so that the operator defined by the restriction of 
the measure p to the exterior of the ball decays in the norm as the ball extends; here the 
boundedness conditions described in Sections 5.3 and 5.4 play a key role. This implements 
the basic property of compact operators: the norm limit of a sequence of compact operators 
is compact. 

The easiest compactness conditions follow from the Sobolev—Rellich embedding the- 
orems (see, e.g., [32]). Let, for example, p(dx) = V(x) dx, V € L® and V > 0 as 
|x| — oo. In the ball Br, Hélder’s inequality gives | J Be |u|? V dx| < lu ee IV llno* Bp) 
with some q* > d/2, (2q)~! + q*~! = 1. Since q~! > d~! — 27!, the Sobolev—Rellich 
embedding theorem assures compactness of the embedding of H! (Bp) into L¢(Br), and 
therefore grants compactness of the form Br |u|?V dx in H!(Br). Outside the ball, the 
supremum of V goes to zero as R — oo, and therefore, sup,, | Jeb. |u|*V dx|/||u\|? goes to 
zero as R —> oo; this demonstrates the general scheme. One can see that even some singu- 
larities of V are allowed in a compact set, as long as the step involving Holder’s inequality 
goes through. 

Looking at this example, one might get a feeling that relative compactness must be 
closely related to infinitesimal form-boundedness. This is partly correct. If the form g is 
compact with respect to h, it is infinitesimal form-bounded. The converse is not true: even 
the form f |u|* dx is not compact in H! (R¢). To show this, one can take a function uo 
supported in the unit cube and then construct a sequence u ; consisting of the shifted copies 
of u placed in some other, disjoint cubes. Surely, the sequence uj; is not compact with 
respect to ||u|| 2. This demonstrates that one cannot drop the requirement of decay of the 
potential at infinity. 

For a nonnegative measure p, the necessary and sufficient compactness conditions in 
terms of capacity were first found by Maz’ ya [89], and later developments (see [4,91,93]) 
are related to finding equivalent formulations, in particular, in terms of potentials, similar 
to Theorem 5.2. We present here the initial formulation from [89]. It uses the function of 
sets defined by 


p(F) 
Cap(F)’ 


u(F)=n(F; p)= 


provided the Bessel capacity is positive, and 7(F’) = 0 otherwise. 
THEOREM 5.8. The conditions 


lim sup{z(F): diam(F) < 5} =0 (5.18) 
60 
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and 


lim sup{z(F): F CCBr, diam(F) < 1} =0 (5.19) 


R>co 


are necessary and sufficient for compactness of the form f \u |? o(dx) in the Sobolev space 
H'(R‘), d >3. 


The compactness conditions for d = 2 are considerably more cumbersome, see [4,93]. 
Recalling the discussion preceding Theorem 5.8, note that (5.18) is a local condition, re- 
stricting the local singularities of p, while (5.19) is a condition of decay at infinity. To 
understand why the theorem is likely to be correct (not proving it, of course), one can just 
try constructing a counterexample, a sequence, bounded in H!, but not compact with re- 
spect to the form g. On the one hand, one might try taking some function ug with compact 
support and then construct a sequence u,, of shifted functions. Supports of such functions 
run away towards infinity and the global condition (5.19) forces u, to 0 thus failing our 
effort. Another attempt might consist in, again, starting with a function uo with compact 
support and constructing a sequence of functions u, with disjoint supports, but not run- 
ning away. To do this, one takes up, (x) =2@-?/?u(2"x), so that ||un || ,2 are bounded and 
separated from zero. The size of the supports of u,, decays very fast therefore one can shift 
them together, so that the supports are disjoint, and fit this infinite sequence into some 
fixed ball in R¢. However, this time, the condition (5.18) forces glu] to zero, and again 
we have convergence. The actual proof, both of necessity and sufficiency, is based upon 
these considerations; see [89] for details. 

Using estimates from below for the capacity, say, via Lebesgue or Hausdorff measure, 
one can derive more transparent sufficient compactness conditions. For example, following 
Corollary 5.5, one obtains the following result as a consequence of Theorem 5.8. 


COROLLARY 5.9. Suppose that p(dx) = Vdx with a function V > 0 which belongs 
locally, i.e., on any ball, to the weak class ieee For any ball Br, let meas({x € Br, 
V(x) > t}) = o(t~4/") as t > 00, and for some functions s(R),t(R) > 0 as R> o, 
meas({x € CBr, V(x) St} < s(R)t~4/*) fort > t(R)~!. Then the form f |u|?V dx is com- 
pact in H'(R4), d > 3. 


Similar to Theorem 5.7, one obtains a compactness criterion for the case of a signed 
measure (see [96]). 


THEOREM 5.10. Let p be a measure on R¢,d > 3. The form glu] = f |u|? dx is compact 
in H! if and only if there exists a vector-valued function T € Le. and a function I" € om 
such that p = div F + I and the form fare + |p|) |u|? dx is compact in H!. 


The proof of the sufficiency part goes in the same way as in Theorem 5.7. Necessity is 
by far more intricate. It turns out that one can use TF = —V(—A)7!p and [9 = (=A) py. 
An attempt to derive sufficient conditions for compactness of the form g with respect to 
the magnetic Dirichlet form 5 4[u] = f |Vu + iAu|* dx from the above results along the 
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lines of reasoning for boundedness or infinitesimal boundedness, fails. In fact, supposing 
that the “nonmagnetic conditions” are satisfied, we take a sequence u, such that h 4[un] is 
bounded. From the weak diamagnetic inequality (3.12) it follows that the sequence uv, = 
|un| is bounded in H!, and according to the theorems just stated, it is compact with respect 
to g. However, it is the sequence v, that is compact due to this reasoning, not u,, as we 
wish. Hence, to obtain compactness in this case, we need some more instruments. 

Recall that we are interested in compactness of the Birman—Schwinger operator 
in (5.16), Kg,.ba> where h alu] = ||(V + iA)u||? is the quadratic form of the operator 
—A, see Section 2. Suppose that the measure p is nonnegative and compare Kg, 4 4 
with operator Kg) corresponding to the nonmagnetic Laplacian; from Theorem 5.8 we 
already know compactness conditions for the latter. However, Kg, possesses one more 
important property, it is positivity preserving (see also Section 7.5). In fact, (—A + 1)7!/2 
is an integral operator with positive kernel; this can be seen from the explicit formula for 
the kernel in terms of modified Bessel functions, or from the representation 


(See pac f° exp 1))t7? dt (5.20) 
0 


and the Poisson formula for the heat kernel (integral kernel for exp(tA)). So, for 
any nonnegative functions u and v the expression (Kg, yu, v) = f(-A+ 1)7'/?u x 
(-A+ 1)~!/2 Bp (dx) is nonnegative, which implies that Kg,,5u 2 0 ae. for any u > 0. 
This property is called positivity preserving. Now we use the strong diamagnetic in- 
equality in Theorem 9.2 (see Section 9.2), which, after comparing (5.20) and similar 
representation for (—A.4 + 1)7!/2, gives that the integral kernel of (—A.4 + 1)! (gen- 
erally, a nonreal one) is majorized by the one of (—A + 1)7!/2, ((-Ay + 1), yl < 
(-A+1)7!/(x, y) ae. This majoration leads us to I(Kg,.b.44, v)| < (Kg,,5 |u|, |v|) and 
therefore 


[Kgpba¥(a)|< Kg, 5lul(x) ae. (5.21) 


For operators satisfying a relation like (5.21) one says that Kg, , is dominated by Kg,.. 
It is an important question, which properties of the dominating operator are inherited by 
the dominated one. About compactness such a property was established by Pitt [106]. This 
gives us a sufficient compactness condition for the magnetic quadratic form. 


COROLLARY 5.11. Let Aé L2 (RR), let the measure p be nonnegative, and let the 
form g[u] be compact with respect to h{u] = \|Vull?. Then g[u] is compact with respect 
to bh. a[u] = || Vu + iAu|l?. In particular, this is the case if the hypotheses of Theorem 5.8, 
d > 3, are fulfilled. 


Note that the approach above does not apply to the case of a nonsign-definite measure p, 
where nothing but separate compactness of the forms corresponding to the positive and 
negative parts of the measure p is known to grant compactness of the whole gy. 

We discuss now a somewhat different case, compactness of the form g = gp in the 
space h!, the closure of A(R“) with respect to the metric ||Vul|?, d > 3. This space lo- 
cally coincides with H! but the conditions on the behavior at infinity are weaker. Indeed, 
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functions in h! do not have to belong to L*; according to the Hardy inequality one can 
only be sure that they belong to L* with weight |x|~?. Therefore the local conditions of 
compactness of the form g,, are the same here as for H!, but the global conditions are 
more restrictive: one has to control the quantity 7(F’) not only over the sets with diameter 
not bigger than 1, as in (5.19), but over all compact sets. The following result can be found 
in [91] (see also [89]). 


THEOREM 5.12. Let p be a nonnegative measure. The form gp is compact in h! if and 
only if the condition (5.18) is satisfied and 


lim sup{ p(F): diam(F) < 5} =0, (5.22) 
560 

limsup{p(F): F CCBr} =0. (5.23) 
R->©o 


There is also an analogy of Theorem 5.10 for this situation (see [96]). 


THEOREM 5.13. Let p be a nonsign-definite measure. To ensure compactness of the 
form Gp in h! it is necessary and sufficient that there exists a vector-function T € L? 


loc 
such that p = div T and that the form 4 [I |* |u|? dx is compact in h'. 


The “sufficiency” part of Theorem 5.12 carries over to the magnetic case in the same 
way as Theorem 5.8. 


6. Qualitative spectral analysis 


Having defined a Schrédinger operator, H = Ho + V, the next question one tries to answer 
is about the qualitative structure of its spectrum. 

There are at least two physically motivated situations, where discrete spectrum comes 
into consideration. If the electric potential vanishes at infinity, one must usually expect 
that the Schrddinger operator has essential spectrum on the positive semiaxis, with some 
negative eigenvalues, finitely or infinitely many. On the other hand, the electric potential 
may grow at infinity, similar to the harmonic oscillator, and here it is natural to expect 
that the whole spectrum is discrete, consisting of a sequence of eigenvalues tending to 
infinity. (Spectral properties in the case of potentials tending to —oo, see Section 4.2, are 
completely unknown for d > 2.) 

We are thus going to look for answers to the following questions. 

1. Is the operator nonnegative (the negative spectrum is empty)? 

2. Is the negative spectrum finite? 

3. Is the negative spectrum discrete? 

4. Is the whole spectrum discrete? 

In quantum mechanical applications one usually considers the Schrédinger operator 
with the square of Planck’s constant in front of the Laplacian. It is important also to find 
conditions for the answers to the above questions to be the same for the whole family 
Hyp =—WA-V. 
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As soon as the existence of some discrete spectrum has been established, additional 
questions concern how to describe it quantitatively, finding estimates or even asymptotics. 
These questions are addressed in the sequel. If the essential spectrum is nonempty, the vast 
field of scattering theory emerges; we do not discuss this topic in the present chapter. 


6.1. Positivity 


The first question seems to be the easiest one. As a direct consequence of Theorem 5.7, 
one gets the following result. 


THEOREM 6.1. Let the measure p satisfy one of the conditions of part one of Theorem 5.7 
so that the constant C, there is not greater that 1. Then the operator defined by the form 
|Vul|? — Gp[u] is nonnegative and thus its negative spectrum is empty. For a nonnegative p 
the conditions of part one of Theorem 5.2 with proper C\ are also necessary for this. 


REMARK 6.2. As it was explained in Remark 5.3, there is a gap, controlled by a factor 
depending only on dimension, in the constants appearing in the (necessary and sufficient) 
conditions. 


Discreteness and finiteness for all h. We proceed to the case when there may be some 
negative spectrum. 

Starting, probably, from Friedrichs’ paper [44], a relation between spectral properties of 
the Schrédinger operator and compactness properties of some embeddings was established 
(although embedding theorems were not invented by that time). It is in the fundamental 
paper by Birman [14] that this relation was emphasized and understood, and one may say 
that a major part of modern spectral analysis of Schrédinger operators, both qualitative and 
quantitative, is based upon this paper, its ideas and methods. 

We formulate the results from [14] (see, mostly, Theorem 1.4 therein) in a form which 
is convenient for our purpose. 


THEOREM 6.3. Let h and g be quadratic forms in a Hilbert space H, defined initially 
on D°, such that b is positive and closable, and g is closable with respect to h. Assume, 
moreover, that the conditions of (the KLMN) Theorem 3.7 are satisfied for hh — g. Let 
H(h) be the self-adjoint operator defined by the quadratic form h*h — g. Denote by D, 
resp. D1, the closures of D° with respect to norms b{u], resp. b[u] + ||u\|?. Then the fol- 
lowing statements are true: 
(1) For the negative spectrum of H(h) to be finite for all h > 0, it is sufficient, and for 
nonnegative g also necessary, that the form g is compact in the space D. 
(2) For the negative spectrum of H(h) to be discrete for all h > 0, it is sufficient, and 
for nonnegative g also necessary, that the form g is compact in the space D. 


Note that the requirement of closability of g with respect to h° is redundant: it is satisfied 
automatically if the compactness conditions are fulfilled. 
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REMARK 6.4. Since the operator h~*H (h) corresponds to the quadratic form h — h~7g, 
where the parameter f~? stands before the perturbation and plays the role of a coupling 
constant, the statements of Theorem 6.3 hold also for this situation. 


Applying Theorem 6.3 to compactness conditions obtained for particular quadratic 
forms in the preceding section (Theorems 5.12 and 5.13), we get concrete conditions for 
finiteness, resp. discreteness, of the spectrum for all fi > 0 for the nonmagnetic or magnetic 
Schrédinger operators. 


THEOREM 6.5. For the Schrédinger operator H) = —h* A — p defined by means of 
quadratic forms, one has that: 

(1) For the negative spectrum to be finite for all h > 0, it is sufficient that the condi- 
tions of Theorem 5.13 are satisfied; for a nonnegative measure p, the conditions of 
Theorem 5.12 are necessary and sufficient. 

(2) For the negative spectrum to be discrete for all h > 0, it is sufficient that the condi- 
tions of Theorem 5.10 are satisfied; for a nonnegative measure p, the conditions of 
Theorem 5.8 are necessary and sufficient. 

(3) The sufficiency statements above for nonnegative measures hold for the magnetic 
Schrédinger operator with magnetic potential A € Lees 

The particular sufficient compactness conditions from Section 5.5 lead immediately to 

more transparent conditions for discreteness or finiteness of the negative spectrum. We 
present just two examples, more can be found in [13,91,113]. 


COROLLARY 6.6. If V € L4/?(R4), d > 3, then the Schrédinger operator —h* A — V 
has finite spectrum for all h > 0. If d>3, V=V, + Vo, Vi € L4/?(R4), V2 € L©(R®), 
V2 — 0 at infinity, then —h? A — V has discrete negative spectrum for all h. 


6.2. Birman—Schwinger principle 


The finiteness and discreteness conditions for a fixed h (we set i = 1) are more intricate, 
but still can be obtained, not directly from Theorem 6.3 but rather from the more univer- 
sal and crucial Birman—Schwinger principle (see also Section A.10), concealed in [14] as 
Lemma 1.3, being up to now the main instrument in the spectral analysis of singular oper- 
ators (later, Schwinger proposed this principle in a considerably less general form [124]). 


THEOREM 6.7 (Birman-Schwinger principle). Under the conditions of Theorem 6.3, the 
number of negative eigenvalues of the operator H(h) equals the number of eigenvalues 
in (h, 00) of the operator Tyg (see (5.15)) or Kg y (see (5.16)) defined by the quadratic 
form g in the space 9, provided one of these numbers is finite. Otherwise, for both opera- 
tors the dimension of the spectral subspace in the corresponding interval is infinite. 


One obtains Theorem 6.3 as a particular case — directly for finiteness (for a compact 
operator, the number of eigenvalues above fh is finite for any A > 0), and with 0, in place 
of 0 for the discreteness. 


Schrédinger operators with singular potentials 447 


6.3. Finiteness and discreteness of the spectrum 


For a fixed fi (again we set fi = 1) it is more convenient to apply Theorem 6.7 directly. 
The mechanism of establishing finiteness of the discrete spectrum of Tyg above f = 1 for 
g=f |u |? o(dx) is the following. For a fixed R, split the measure p into two parts, pr, sup- 
ported in the ball Br, and pr, supported outside the ball. Correspondingly, the quadratic 
form g splits into two parts, g = gr + gr, as well as the operator Tyg = Tr + Tr. If local 
compactness conditions are satisfied, the spectrum of Tr above | is finite. So, one has to 
suppose that the norm of TR (or, even more generally, the norm of the positive part of Tr) 
is less than 1. Then the spectrum of iy above | is finite. Furthermore, discreteness of the 
spectrum of 7 for fixed h = 1 is equivalent to finiteness of the spectrum of the operator 
T — « for any ¢ > 0. This line of reasoning gives also necessary conditions for finiteness, 
resp. discreteness, of the negative spectrum. 

Implementing this strategy to particular forms corresponding to Schrédinger operators, 
we arrive at the following description of the spectrum. Less general conditions were found 
in [14,89,91]. 


THEOREM 6.8. Let d > 3 and let the measure p satisfy the condition (5.18). 

(1) If for sufficiently large R the restriction of p to the exterior of the ball Br satisfies 
the conditions of the first part of Theorem 5.7 so that the constant C in the resulting 
estimate is not larger than 1, then the negative spectrum of the operator —A — p is 
finite. 

(2) For ¢ > 0, define a measure pz, Pe(F) = sup{(p(e) — € meas(e))+, e C F} (it is the 
positive part of (e — emeas)). Suppose that for any ¢ > 0, the restriction of P¢ to 
the exterior of a sufficiently large ball Br, R= R(é), satisfies the conditions of the 
first part of Theorem 5.2 so that the constant C in this theorem is less than 1. Then 
the negative spectrum of the operator —A — p is discrete. 

(3) The statements above hold also for the magnetic Schrédinger operator with mag- 


. . 2: 
netic potential A € Lj,,. 


If the measure ¢ is nonnegative, one can even give exact values of the constants involved 
(see [89,91]). 


THEOREM 6.9. Let d > 3 and suppose that the condition (5.18) is fulfilled. Denote 
by S(e) the quantity 


lim limsup{z(F): F CCBr, diam(F) < 5}. (6.1) 


>09 R-+00 


For discreteness of the negative spectrum of the Schrédinger operator —A — p the con- 
dition S(p) < 1/4 is sufficient, and S(p) <1 is necessary. If one drops diam(F) < 6 
from (6.1), the same conditions are sufficient, resp., necessary, for finiteness of the neg- 
ative spectrum. 
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We give an example of the finiteness condition in elementary terms. This condition fol- 
lows from the estimates expressed in terms of the capacity, taking also into account the 
relation of the capacity and Lebesgue measure (5.6). 


COROLLARY 6.10. Let V > 0, d > 3. Suppose that V = V; + V2, where V; € L4/?(R?) 
and Vz < §(|x|+ 1)~*. Ifc < (d —2)?, then the negative spectrum of the operator —A — V 
in L?(R¢) is finite. 


The condition here is exact in the sense that if one sets c = (d —2)?, the result may break 
down, i.e., finiteness does not hold for all values of the coupling constant. The authors 
failed to find examples where the negative spectrum is discrete but not for all values of the 
coupling constant (with local compactness conditions still holding). 


6.3.1. Discreteness of the whole spectrum. Physical intuition suggests that if the po- 
tential V(x) tends to +00 as |x| — oo, one must expect that the whole spectrum of the 
Schrédinger operator — A + V is discrete: conservation of energy does not allow a particle 
to escape to infinity. As it often happens, the intuition turns out to be essentially correct. 

Here, again, the Birman—Schwinger principle enables one to reduce the problem to com- 
pactness of certain embeddings. Let Ho be the unperturbed operator associated with the 
quadratic form fo (e.g., Ho = — A) and for the measure p the self-adjoint, semibounded op- 
erator H, = Ho + p corresponds to the quadratic form ho + g, defined initially on (R¢). 
Choose s so that hs[v] = bo[uv] + go[u] + s||u||? > |u|]. Consider the space D defined as 
the closure of A(R) in the norm [uv]. 


PROPOSITION 6.11. The following statements are equivalent: 
(1) The spectrum of Hp = Ho + p is discrete. 
(2) The form |\u||? is compact in the space D (or, in other words, the embedding of D 
into L?(IR@) is compact). 


We present the proof which demonstrates the beauty of the Birman—Schwinger principle. 


PROOF OF PROPOSITION 6.11. Without loss of generality we may set s = 0. Discreteness 
of the spectrum of the operator means that for any 1 > 0 the spectrum of the operator H, 
below A is finite. This is equivalent to the negative spectrum of the operator H, — 1. being 
finite. The operator H, — A is defined by the quadratic form ho[u] + gp[u] — Allu \|7. Now, 
according to the Birman—Schwinger principle, the number of its negative eigenvalues is 
equal to the number of eigenvalues above A~! of the operator T defined by the form ||u||? 
in the space with norm ho[u] + gp[u], i.e., in . The quadratic form of T, i.e., \|u||7 is 
positive, therefore, T is a positive self-adjoint operator. Finiteness of its spectrum above 
any t = A~! means exactly that the operator is compact. 


Having Proposition 6.11 at disposal, one can further obtain different discreteness condi- 
tions, just by finding conditions for the compactness of the above embedding. 

The mechanism of proving this compactness is usually the following. Take R large 
enough and split the form ||u||? into two terms, ||u||? = nr[u] + fia[u], where the first 
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form corresponds to integration over the ball Br, and the second one to integration over 
its complement. In the case of Ho being the Laplacian, the first form is compact in H!, 
due to the Sobolev—Rellich embedding theorem. So it remains to show that the form nr[u] 
satisfies 


nrlu] <e(R)bolu] withe(R)>O0as R>~, (6.2) 


and it is here the additional analytical work begins. As soon as (6.2) is fulfilled, this gives a 
norm approximation of the operator T (generated by the form ||w||*) by compact operators, 
so T is compact. The most simple condition for this is just to require that p(dx) = V(x) dx 
and V tends to +oo at infinity. Then, if V > e—! for |x| > R, (6.2) follows from 


i luPdx <e f Vinieax <e(totel + f vias). 
|x|[>R |x|>R 


This gives the following sufficient condition, originally obtained by Friedrichs [44]. 
THEOREM 6.12. If V(x) > +00 as |x| > ©, then the spectrum of —A + V is discrete. 


Theorem 6.12 was later substantially improved. In [102] it was shown that for V > 0, 
in dimension 1, the condition of V going to +00 can be replaced by the requirement for 
the integral of V over intervals of every fixed size to tend to +00, when the interval moves 
to infinity, and this property is necessary and sufficient for discreteness of the spectrum. 
In higher dimensions, this condition is still necessary (with intervals replaced by cubes 
or balls), but not sufficient. The necessary and sufficient condition, found by Molchanov 
[102] is as follows. 

The set F in the cube Q = Qy with sidelength 6 is called negligible if cap(F, O)< 
y cap(Q, OQ) for some y < 1, where Oi is a concentric cube, twice as large, and cap(F, QO) 
is the Wiener capacity (see Section 5.1). For d 2 3 one can replace cap(F, QO), resp. 
cap(Q, QO), by the Bessel capacity Cap(F’), resp. cap(Q). Introduce the Molchanov func- 
tional 


MV, Q)=M(V, QO; y) = int{ [ vena], (6.3) 
Q\F 


where infimum is taken over all negligible sets in the cube Q. So M(V, Q) can be small if 
V is large only on a small, nonessential set, although the integral of V over the whole cube 
might be large. For the case of a measure, M(V, p) is defined by (6.3), with the integral 


replaced by o(Q \ F). 
THEOREM 6.13 (Molchanov’s criterion). There exists y such that the condition 
M(V, Os; vy) > +00 as Qs >, (6.4) 


for any 5 > 0 is necessary and sufficient for discreteness of the spectrum of the operator 
—A+V in L?(R¢). 
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In other words, the discreteness condition declares that not only the integral of V over 
the whole cube must be large, but also the integral over complements of all negligible sets. 
So, if V is supported in a negligible set in any cube (or just in a sequence of cubes going 
to infinity), it cannot assure discreteness of the spectrum, no matter how large V is. 

Although Molchanov found some concrete value of the constant y, it remained un- 
known, for more than 50 years, how close to zero this constant can be, in other words, how 
small the negligible sets are allowed to be. Formally, the smaller y is, the larger M/ is and 
therefore the less restrictive are the conditions on V in (6.4). This question is especially 
important if one replaces the function V by a measure p, which may be supported on some 
small, probably, negligible sets. This problem was solved only recently, and the result by 
Maz’ya and Shubin was quite unexpected [94]. The negligibility characteristic, y, can be 
taken arbitrarily close to 0. 


THEOREM 6.14. Let p be a nonnegative measure such that the operator —A + p can be 
defined via quadratic forms. Then, for any function y : (0,00) — (0, 1), the necessary and 
sufficient condition for discreteness of the spectrum of —A + p consists in 


M(p, Qs; 7 (5)) > +00 as Qs co V5>0. (6.5) 


6.4. Discreteness of spectrum for magnetic operators 


Due to the diamagnetic inequality, the condition (6.5) is sufficient also for discreteness 
of spectrum of the magnetic Schrédinger operator; the reasoning goes in the same way 
as in Corollary 5.11. However, this condition is far from being necessary. It was pre- 
dicted first by physicists, and then justified mathematically that the magnetic Laplacian 
—A4=-—(V +iA)? can have discrete spectrum even without any electric potential. This 
phenomenon is called a magnetic bottle. The physical explanation is that the magnetic 
field, acting orthogonally to the velocity of the particle, forces the particle to turn, and if 
the magnetic field grows at infinity, this may prevent the particle from escaping to infinity. 
In fact, if |B(x)| — oo at infinity, then in dimension d = 2 the spectrum of the magnetic 
Laplacian is discrete. In dimension d > 3 this is not sufficient since the magnetic field B(x), 
being a vector now, may change its direction, and therefore it may fail to prevent a particle 
from escaping (it was Dufresnoy [31] who constructed the first example). One may require 
that the direction of the field varies sufficiently slowly, and this implies discreteness of 
the spectrum. In the presence of the electric potential V the situation becomes even more 
complicated, since it is the cooperation of both fields that determines the spectrum, and 
it is possible, that acting together, electric and magnetic fields grant discreteness of the 
spectrum while separately they fail to do this. 

Until recently the study of this problem gave some sufficient conditions, far from neces- 
sary ones, as well as spectacular examples demonstrating various pathologies. Lately, how- 
ever, discreteness conditions, necessary and sufficient, were found by Kondratiev, Maz’ ya 
and Shubin [65,66]. 

As usual for operators with magnetic fields, the case d = 2 is more clear. We present here 
the sufficient condition from [66], nicely illustrating interaction of magnetic and electric 
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fields. To avoid the influence of other factors, we assume that the magnetic potential A 
belongs to C! and V is locally bounded. 


THEOREM 6.15. For the magnetic Schrédinger operator in L? (IR) the effective potential 
ye is defined as 


Vet (x) = Vix) + 8 B(x). 


Suppose that for some 65 € [—1, 1], Vet(x) —> +00 as |x| — o. Then the operator 
Hay=—-(V+ iA)? + V is essentially self-adjoint on Z(R*) and has discrete spectrum. 


In less elementary terms, it is even sufficient that vetr) satisfies Molchanov’s condi- 
tion (6.4). 

The conditions of Theorem 6.15 are not necessary for discreteness of the spectrum but 
they are exact in the sense that there are examples of the conclusion failing if the conditions 
are satisfied only for some 6 outside the interval [—1, 1]. 

In higher dimensions, not only the values of the electric and magnetic fields con- 
tribute to the effective potential but also a characteristic of the direction of the mag- 
netic field; the smoothened direction of the magnetic field B(x) = dA(x) is defined as 
vjk(x) = x 1B\ (x)) Bjx(x)/|B(x)|, where x is a Lipschitz function on [0, 00), x(r) = 0, 
r>1/2,x@=1,r>1,x(W) =2r—1,r €[1/2, 1]. Kondratiev and Shubin obtained the 
following result [66]. 


THEOREM 6.16. Suppose that Bj, are Lipschitz functions, and for some positive measur- 
able function X (x), the inequality ¥°,. |0xvjx| < X (x) holds for all x € R¢. Fore > Oand 
6 €[0, 1), define the effective potential 


bd 


2 
Lt 


Voi (x) = Vix) + . |B(x)| 


—I+e 
If for some 6, € the effective potential satisfies the Molchanov condition (6.4) (in particu- 
lar, if ven (x) — +00 at infinity), then the operator H, y is essentially self-adjoint, semi- 
bounded and has discrete spectrum. 


Several more transparent conditions following from Theorem 6.16 are given in [66]. We 
present here just one of them. 


COROLLARY 6.17. Suppose that | gradB(x)|(1 + |B(x)|)~37/7 > 0 as |x| > oo. If the 
effective potential V(x) + syIBI satisfies the Molchanov condition (6.4), in particular, if 
it tends to +00 at infinity, then the conclusion of Theorem 6.16 hold. 


Theorem 6.16 and other results in [66] are carried over also to the magnetic Schrodinger 
operators on Riemannian manifolds with bounded geometry. 

The most recent result in this field, established by Kondratiev, Maz’ ya and Shubin [65], 
finally gives the necessary and sufficient conditions for discreteness of the spectrum of 
the magnetic Schrédinger operator. These criteria also involve local characteristics of the 
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magnetic and electric fields, so that their sum has to tend to infinity at infinity. However, 
these characteristics are more elaborate than in Theorem 6.16. For the description of the 
electric potential V, the Molchanov functional M(V, Q; y) (see (6.3)) is used. To describe 
the magnetic field, its local energy 40(Q) = “o(Q, A) in the cube Q is introduced as 


Vu+iAul*d 
Jol u u| =|. (6.6) 


Ho(Q) =int| JgluBax 
where infimum is taken over Lipschitz functions in Q. Thus j49(Q) is the lowest eigenvalue 
of the Neumann problem for the magnetic Laplacian in Q. The discreteness conditions re- 
quire that some combinations of these two characteristics grow at infinity. To describe 
these combinations, we consider a positive function g(4), 6 € (0, 59) such that g(d) > 52 
and ¢(6) + 0 as 6 — 0. Let also the function f :[0, oo) — (0, oo) be continuous, decreas- 
ing and, moreover, f(t) < (1 +log(1 + t))~!,d =2, and f(t) < (1+ n°-%/,d >2. 


THEOREM 6.18. The spectrum of the magnetic Schrédinger operator —(V +iA)* + V is 
discrete if and only if for some 59 and some pair of functions f and g as above, and for 
every 6 < 40, 


11005) +5 “M(V, Qs; y(8)) + +00 as Os > &, (6.7) 
where y (5) =y (6; f, 8) = cad? f (57 W0(Qs))g(5)". 


A more simple, sufficient but not necessary discreteness condition is that for some 
fixed y and every 6 < do, 


o(Qs) +8 4 MV, Qa; y) > +00 as Qs > 00. 


7. CLR estimates 


In this section we begin the study of quantitative characteristics of the discrete spectrum of 
Schrédinger-type operators. The first quantity to be considered is the number of negative 
eigenvalues, and here due to tradition we consider Hy = —A— V. 

The first bounds on N(0; Hy) having the correct strong coupling behavior (see the 
Introduction) are due to Simon [130], however, they are not expressed in terms of the 
phase-space volume; see the right-hand side of (1.1). The breakthrough was independently 
achieved in the 1970s by Cwikel [28], Lieb [76] and Rozenblum [116], who gave three 
very different proofs of the following inequality, now known as the CLR estimate. 


THEOREM 7.1 (CLR estimate). If d > 3 and Vs € L4/?(R¢), then the number of negative 
eigenvalues of the operator —A — V satisfies 


NO: Hy) <ea f | VeCy"as (7.1) 
Rd 


for a suitable constant cq. 
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We make here an important observation concerning (7.1) and all the following spectral 
estimates. Although the eigenvalues of the operator depend on the potential as a whole, 
only its positive part is present in the estimate. In other words, the influence of the negative 
part of V, which may decrease the number of negative eigenvalues, is not taken into ac- 
count. At present the methods in qualitative spectral analysis do not allow one to evaluate 
the interaction of the positive and negative parts of the potential. 

The three original methods for proving (7.1), as well as later developments, of which 
we especially note the proofs by Li and Yau [75] and Fefferman [42] are based upon dif- 
ferent mathematical machinery, admit different generalizations, and give different values 
of the constant cg. Lieb’s approach yields the best constant but the question of the optimal 
constant in (7.1) remains unanswered; to be precise, one would like to determine 

Ro,d := sup Nr HY) (7.2) 


eh, A ee 
Vere ie. ax 


Other problems we address here are generalizations to Schédinger operators with mag- 
netic fields, with variable coefficients, and Schrédinger operators with operator-valued po- 
tentials. 

In recent years the methods of Cwikel, Lieb, and also Li and Yau, have inspired sig- 
nificant progress, which we present in subsequent sections. Thus it is natural to discuss 
their methods here. Before doing so it is necessary to take another look at the Birman— 
Schwinger principle (cf. Section 6.2) and, in particular, the Birman—Schwinger operator 
already used for the needs of the qualitative analysis in Section 5.5. 


7.1. Birman—Schwinger operator 


We are interested in estimating the number of negative eigenvalues of the Schrédinger 
operator —A — V, where V: R¢ —> R is a measurable function and —A is the negative 
Laplacian. The Laplacian — A corresponds to the closed quadratic form 


bul= f|vuco|Pae, u€D(h) =H! (R’). 
R 


Its spectrum is absolutely continuous and coincides with the semiaxis [0, 00). 


EXAMPLE 7.2. If u € Z(R?), then the resolvent (—A + E?)~!, E > 0, can be expressed 
explicitly as 


-VEWx-y 


[a+ Ey 'w}oy =m f “wey ay. (73) 
R3 |x—y 


The quadratic form associated with the potential is given by g[u] = gy[u] = Sra V(x) x 
|u(x)|? dx. Assume first that V > 0. In order to estimate the eigenvalues below —E of 
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—A — V, according to Glazman’s lemma (see Section A.9) and the Birman—Schwinger 
principle, we should study subspaces where the ratio 


glu] _ Spa V(x)|u(x)|? dx 
blu] + Ellul? pa |\Vu(x)|? dx + E fea u(x)? dx 


is smaller than 1. Setting here v = (—A+ E)'/2y and thus u = (—A + E)~!/*v we obtain 


glu] _ fpr v—At+ £)'?V(—A+ Ey Vadx 
blu] + Ellul? Fea lw)? dx 


It follows therefore that the eigenvalues of the operator Ty 44£ defined by g with respect 
to the norm (6[-] + E|| - ||)!/? are identical to the eigenvalues of the operator 


Ke(V) =Kgy+e =(-A+ BE)? V(-A+ E) 1? = x*X (7.4) 


on L?(R?), where X = Xg(V) = V!/2(-A + E)~!/. This operator Kg(V) has the same 
nonzero eigenvalues as 


Ke(V)=V!?(-A+ E) ! v1? = XX’; (7.5) 


both operators are called Birman—Schwinger operators, and it depends on the particular 
problem, which of them is more convenient to use. 

On R3, for suitable V, Kg(V) is a Hilbert-Schmidt operator. Since (—A + E)~! has 
the integral kernel (41|x — yp exp(—VE|x — y|) (cf. (7.3)), 


N(-E; Hy) 
<tr(Ke(V)Ke(V)*) 


1 
(4x)? 


‘ae V(x)V(y) [x — yl"? exp(-2V E|x — yl) dx dy. (7.6) 


For E >0 and a € (0, 1] we define the generalized Birman—Schwinger operator 


Kag(V) = (V(x) — (1—a@)E) "(A +aE)1(V(a) — (1) BE)” 
=Vi?(-A+aE) v1”, (7.7) 


where Vy = (V(x) — (1 — a)E) + denotes the positive part of the function V(x) — 
(1 — a)E. Lieb and Thirring introduced the following modification of the Birman— 
Schwinger principle [85]. 


THEOREM 7.3. The number N(—E; Hy) of eigenvalues of —A — V in (—w, —E) is 
bounded above by the number of eigenvalues of the generalized Birman—Schwinger oper- 
ator Kyr(V) in (1, ©) counting multiplicities. 
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7.2. Cwikel’s method 


This method, having its roots in harmonic analysis, handles a class of operators for which 
X£(V), defined immediately after (7.4), is a particular case. Such operators are defined by 
means of the Fourier transform in the following way. 

If FY denotes the Fourier transform and g € L©(R?) then 6 F¥—!(g.F¢) defines a 
bounded operator on L?(IR“); we shall denote it by g(—iV). The weak L? space consists 
of all the functions g for which 


1 
gle cay = ae - (meas(|g(-)| > t)) IP — o; (7.8) 
we already encountered it in Section 5.3. 


Assuming that f ¢ L?(R¢), ¥g € L? (R®) with 1/p + 1/p’ = 1 and 2 <p <ov, we 
can define 


ZpeW=fe(-iV)y, we-(R‘), (7.9) 
which extends to a bounded operator on L?(R¢). Cwikel proved the following result [28]. 


THEOREM 7.4 (Cwikel’s inequality). For 2 < p <0, let f € L?(R“), Fg e€ L? (R¢) 
with 1/p+1/p'=1. Then Zf,¢ is a compact operator on L?(R¢) and, in fact, it belongs 
to the weak trace ideal ©%,. In particular, its singular values jz obey? 


k/P lel <cpallfliollgiizp, K=1,2..., (7.10) 
where Cp,q is a constant depending only on p and d. 


In particular, 


4 \1-2/p 
Crd & P ol Pal? 
2\p/2—-1 


For d 2 3, Theorem 7.4 can be applied to our operator Xo(V) = Zy,g with p=d 
as the functions f,g chosen as g(x) = 5m (a4 bPr(st Ly ix]! 4 with glia CS 


5 a cas *T(S1 ty and f(x) = V(x). The Birman—Schwinger principle gives thent that 


FSA" 
N(O; Hy) < of gata errs ( S—*) te val? dx (7.11) 
R 


which yields the constant eB if d = 3 (which is about 17 times greater than the best 
possible value; cf. Lieb’s approach). The estimate (7.11), in conjunction with monotonicity 


y 
3Finiteness of Isl» follows from the condition Fg € Lies 
w 
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(cf. Section A.9, Lemma A.4), proves (7.1) for a general V of variable sign; with the 
constant appearing in (7.11). 

The analysis of the proof of Theorem 7.4, made in [18], shows that, in fact, a much 
more general theorem holds: one can replace the Fourier transform in the definition of the 
operator Z ¢ , by any integral operator with a bounded kernel, which is bounded in L?. This 
generalization might lead to obtaining CLR-type estimates on some noncompact manifolds 
different from R?@, however this possibility has not been explored yet. 

If one tries to apply (7.10) to the Schrédinger operator in dimension d = 2, one has to 
take p = d =2 which is not allowed. A weaker version of Theorem 7.4 for this special 
case was found by Weidl [154]. 


7.3. Lieb’s approach 


E. Lieb applies completely different tools in order to derive the phase-space bound 
on N(—E; Ay); in particular, the Wiener integral representation of functions F of the 
Birman—Schwinger operator K¢(V) given in (7.5). 

If dix, y,, denotes the conditional Wiener measure on continuous paths w(t),0<t <t, 
in R¢ with w(0) =x and w(t) = y, then the Green function for the heat semigroup e’ 4 can 
be represented as 


Beep) 
(4nty-*?exp(— eae Je [dis (7.12) 


At 


The Feynman—Kac formula [112], Theorem X.68, generalizes (7.12) to the semigroup 
eA+V). Using this, Lieb found the following expression for the trace of a function of 
the Birman—Schwinger operator [76]. 


THEOREM 7.5. Let V >0 and V € L?(R¢) + L4(R4), with p =d/2 (if d >3), p>1 
(d =2), p=1(d=1) and p <q <o. Let f be a nonnegative lower semicontinuous 
function on (0,00) satisfying f(0) =0 and x" f(x) > 0 as x > oo for some r < &. 
Define F by 


ee) -y 
F(x) = / f(xy) — dy. (7.13) 
0 y 


Then 


°° dt -|E|t t 
wF(Ke) = | —e / [etcsr(f V(o(s)) as). (7.14) 
0 t Rd 0 


To use (7.14), one supposes additionally that f is a convex function. Then Jensen’s 
inequality applied to the last term in Lieb’s trace formula, yields that 


t 1 t 
r(f V (w(s)) as) < -{ f (tV (w(s))) ds. (7.15) 
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Fubini’s theorem allows one to change the order of integrations, which implies that 


OO ag “ds 
wF(Ke) < f —e [ sv. f =f dx f(V(o(s) +x)). (7.16) 
o ft 0 ¢f JRd 


Since dx is translation invariant, one may ignore the w-term for any field path t > w(t). 
The latter fact allows us to carry out the s-integration and the integration with respect to 
dj10,0,1 using the representation (7.12). In this way we deduce Lieb’s result [76,77]. 


COROLLARY 7.6. Let f be convex and satisfy the conditions of Theorem 7.5. Then 
-aj2 [°° at -ap et 
trF (Ke) < (4m) ma e dx f (tV()). (7.17) 
0 R¢ 


The Birman—Schwinger principle and the monotonicity of F yield 
N(-E; Hy) =n(1; Ke(V)) (B-S principle) 


< F(1)7! Ss F(vj) (0; are eigenvalues of Kz(V)) 
j 


= F(1)'trF(Ke(V)), 


which is valid also in the limit as F tends to zero. Finally, the change of variable t = t V (x) 
yields the CLR estimate. 


COROLLARY 7.7. Let f be convex and satisfy the conditions of Theorem 7.5. Set Za(f) = 
Jo. £(s)s~4/?“! ds) foo f (s)s~!e~$ ds)~!. Then 


N(O; Hy) < (4n)~4/*Za(f) [ ; Vi (x) 4? dx (7.18) 
R 
or, in the notations of (7.2), 
d 
Roa < zune (S + 1) (7.19) 


Hence, to find the best (for this method) constant in (7.1), one has to evaluate 


d 
c= intr (5 + 1)Zae £0, f(0) =0, f nonnegative and convex. 
(7.20) 
With the particular choice 


0, Ss 
s 


< 
—d, acs, 


jo=| 
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for some a > 0 (recall that d > 2), we find that 


re} 2) 


S < +4 
“a S70 x4/22T(—1, x)’ 


(7.21) 


where T(z, x) = i t®—le~' dt denotes the incomplete F function. If d = 3 one gets 
c; < 0.116. 

The following formal computation hints that the above choice of f is, in fact, optimal. 
Indeed, rewrite the right-hand side of (7.19) as 
Jon U(s) f(s) ds 


Di m(f) = [eo m'(s) f (s) ds 


with I(s) = 1(45*)s!~4/? and 


m(s) = | _ ce dt =sI(-1,s). 


Then integration by parts yields 


Joo Us) f(s) > min J 
Joo ms) f(s) m(s) 


Di m(f) = 


which is attained if f(s) ~ 6(s — xmin) Where xmin is the position of the minimum of 


l(s)/m(s). 


7.4. The proof by Li and Yau 


To the Schrédinger operator one can associate another semigroup, also useful in the 
study of eigenvalues. Suppose that V > 0 and consider the operator Ke =V12—A+ 
E)V~'/?; the inverse to the Birman—Schwinger operator (7.5). The semigroup e~!*e 


. : 2% _—+K7! 
consists, under suitable conditions, of trace class operators. Moreover, g(t) := tre~‘ Kpo= 


-1 
eco (Ke a where 4;(K_) are the eigenvalues of Kz. Another way to understand g(t) 
is taking the trace of the Green function of the parabolic equation 


ee ee 
V(x) ° ot 


Considering this equation first on a bounded domain @ C R¢ with Dirichlet conditions and 
using positivity of the aforementioned Green function and the Sobolev inequality (3.11), 
Li and Yau established the estimate g(t) < cat 4/2 J 2 v4@/2 dx, where the constant cg 
depends only on the dimension d. By choosing t = d/(4A;), they obtained the following 
result [75]. 
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THEOREM 7.8. Let 2 be a bounded domain in R4, d > 3. Let A; denote the jth eigen- 
value of the boundary value problem 


| ae AV (x) f (x), (7.22) 
Then 
igh? <a? f veytPas, (7.23) 


where Kq,2* denotes the best constant appearing in the Sobolev inequality (3.11), namely 


ae 1 ele Gon 
48 Jada —2) \Td/2)) 


Let Ay be the largest eigenvalue less than or equal to 1. Then Theorem 7.8 yields 


i yel2 ax SS | val dx 
9) Q 


2 


> NO; -A-V)Kz5e" 1, 


where the last inequality follows from the Birman—Schwinger principle. Some technical 
steps, justified by Li and Yau, make it possible to take the limit “s2 > R@” and also to 
dismiss the condition V > 0. In this way, one arrives at the CLR estimate. 


THEOREM 7.9. The CLR estimate (7.1) holds and the constant is given by cq = 
et-2)/2K4 gx», Where Kq,2* denotes the constant (7.24). 


Further analysis of the proof, performed by Levin and Solomyak [74], has shown that it 
is only the positivity of the heat semigroup and the Sobolev inequality, but not the differ- 
ential nature of the Laplacian, that are essential for this approach. This enabled the authors 
of [74] to carry over the CLR estimate to certain operators with variable coefficients. 


7.5. CLR estimate for positivity preserving semigroups 


In both approaches above the semigroups have an important positivity property. It turns out 
that it is this property that is crucial for eigenvalue estimates. 

Throughout this subsection 2 is a space with a o-finite measure jz. Moreover, L? will 
denote the space L?(92, w), 1 < p< 00. 


460 G. Rozenblum and M. Melgaard 


Positivity. There are two natural notions of positivity for operators acting in the Hilbert 
space L*(Q). First, an operator S$ is nonnegative if (Su,u) > 0 for all wu in the domain 
D(S) of S; this is the positivity in the operator sense. Second, S is positivity preserving 
(P.P.) if (Su)(x) > 0 almost everywhere (a.e.) for any a.e. positive function u € D(S); this 
notion is related to the lattice structure of the L* space. 


Positivity preserving semigroups. Any self-adjoint nonnegative operator T in L? gener- 
ates a strongly continuous contractive semigroup Q(t) = QOr(t) =e7'", 0 <t < oo. The 
class of positivity preserving or, shortly, positive semigroups is defined by the property 
Q(t)u > 0 ae. for any nonnegative function u € L*. Generators of positive semigroups 
can be characterized in terms of their quadratic forms according to the following criterion 
[113], Theorem XHI.50. 


THEOREM 7.10 (First Beurling—Deny criterion). Let T be a nonnegative self-adjoint oper- 
ator on L?(2, du). Extend (Wy, Tf) to all of L? by setting it equal to infinity if v € Q(T). 
Then the following are equivalent: 

(i) Q(t) =e~"" is positivity preserving for all t > 0. 


Gi) (IW, TIWI) < (W, TW) forall y € L’. 
(iii) Q(t) is reality preserving and 


(w+, TW) < (wT) 


for all real-valued w € L?. Here w+ = max{y(x), O}. 
(iv) Q(t) is reality preserving and 


(Wa, Ts) + (Wi. TW) < (Ty) 


for all real-valued  € L*. Here w_ =. — vw. 


Another (related) notion is the one of (2, 00)-bounded semigroup defined as a self- 
adjoint contractive semigroup Q(t) = e~' in L*, which for each t > 0 is bounded as 
acting from L? to L®. Such operators turn out to be integral operators, see, e.g., [60], 
Section XI.1, or [8], Theorem 1.3. Denoting the integral kernel of e~’7 by Q(t; x,y) = 
QOr(t; x, y), (2, 00)-boundedness yields that 


2, 
t = 2 
Mr(t) ss esssup | lor(5:x.)| dy = Jerr ia p00 <00 (7.25) 
x 2 


(for brevity, we write dy instead of w(dy)). 

The kernel Q(t; x, y) is defined almost everywhere on 92 x §2 for any t > 0. One can 
re-define the kernel on a set of measure zero for each t > O in such a way that it becomes 
measurable in all variables (see [8], Lemma 2.2) and symmetric: Q(t; x, y) = Q(t; y, x) 
a.e. We always suppose that this has been done. 

By duality, Q(t) is also bounded as an operator from L! to L*. The semigroup property 
QO(t)) O(t2) = O(t, +2) shows that Q(t) acts from L! to L™ and is factorized through L?. 
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This makes it possible to define the value of the kernel on the diagonal y = x for almost 
all x, 


onxn= f O(t;x,y)O(tr; y,x)dy, t,t2>Oandt)+hm=¢t. (7.26) 
2 


The resulting function is well defined as an element of L°° which does not depend on the 
particular choice of t; and fo. Thus, (7.25) can be rewritten as 


t t 
Mr():=esssup [ Or\=;x,y}Qr\| =; y,x }dy 
x JQ 2 2 


= esssup O(t; x, x). (7.27) 
x 
So we see that 
|Or(t; x, y)| < Mr(t) a.e.onR, x 2x Q, (7.28) 
O< Or(t;x,x)<Mr(t) ae.on Ry x 2. (7.29) 


The same semigroup property, together with contractivity in L?, imply that M7 (ft) is non- 
increasing on (0, oo). We usually require 


[oe 
/ Mr(t)dt<o«, a>0. (7.30) 
a 


We will write T € P if the self-adjoint operator T generates a semigroup which is both 
positive and (2, oo)-bounded. For such 7, the kernel Q7 (t; x, y) is nonnegative: 


)20 ae.onR, x 2x Q, (731) 
)20 ae.onR, x 2. 


Or(t; x,y 


If T ¢ P and T > y with some y > 0, then for any r > —y the operator 7, = T +r 
also belongs to P. The corresponding semigroup is Q7.(t) =e Q(t), thus Mz, (t) = 
e ''Mr(t). It follows that Mr, (t) with r > —y decays at infinity exponentially. 


CLR estimate for generators of positivity preserving semigroups. Let T be a nonnegative 
self-adjoint operator in L*. Suppose that a given measurable function V > 0 (more rig- 
orously, the operator of multiplication by V) is form-bounded with respect to T, with a 
bound smaller than 1. Then the self-adjoint bounded from below operator T — V is defined 
by the method of quadratic forms (see Section 3.2). 

Denote by © the class of all continuous functions G on [0, oo), growing at infinity no 
faster than a polynomial and such that z~!G(z) is integrable at zero; the latter assumption 
implies G(O) = 0. We already encountered this class in Section 7.3. In addition, set 


lee) 
wo= [ z'G(zje“ dz. (7.32) 
0 
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Rozenblum and Solomyak [121], Theorem 2.1, have established the following CLR es- 
timate for a positive semigroup perturbed by a potential V. 


THEOREM 7.11. Let T € P be such that Mr(t) satisfies (7.30) and Mr(t) = O(t~%) 
at zero, with some a > 0. Fix a nonnegative convex function 0 # G € ©, polynomially 
growing at infinity and such that G(z) = 0 near z = 0. Then 


1 (dt 
NO;T-V)< / [ mroctevenax, (7.33) 
80Jo Ff JQ 


as long as the expression on the right-hand side is finite. 


Their method is an “abstract version” of Lieb’s approach. The latter was based upon 
the path integral technique. Instead of this formalism, fairly hard to be carried over from 
the Laplacian to other operators, the authors of [121] use the operator analysis only. As a 
consequence, their approach applies to a quite general situation; requiring from S2 only the 
structure of measure space. 


REMARK 7.12. 1. The finiteness of (7.33) assures that the operator T — V is bounded 
from below. 

2. It follows from convexity that G(z) grows at infinity at least as a constant times z. 
Therefore, the condition (7.30) is necessary in order that the estimate (7.33) be meaningful. 


Since the function G appears in (7.33) as a parameter, one has a family of estimates and, 
consequently, it is possible to optimize in the parameter G. The idea of a parametric esti- 
mate of the type (7.33) is due to Lieb [76], who proved it for the Schrédinger operator. He 
also suggested to use the function G,(z) = (z — a)+, a > 0, where a is a scalar parameter. 
Optimization of G can be performed as described in Section 7.3. 


EXAMPLE 7.13 (Schrédinger operator). Let 2 = R¢ with the Lebesgue measure, 
T = —A. The kernel of e~!? equals Q(t; x,x) = (20) —4/24¢-4/2 on the diagonal. So, 


(7.30) dictates d > 3. Following Lieb [76] (see also [138], p. 96), select G(z) = (z — a)4, 
with some positive constant a to be chosen. Then (7.33) gives 


[o,e) 
NO;-A~¥)< 2ny~4?g5" [ 4-1 G(tV (x)) dx dr, (7.34) 
0 JR 


where, according to (7.32), go0 = Fs ec (l —az')e~< dz. After the change of variables we 
come to the CLR estimate 


N(O;-A—V)< c@) | V(x)2/? dx, (7.35) 
R¢ 
where 


C(G) = Qn) 4" 2)" [ve eee) Mike cami | 


a 
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Then one should optimize in a. For d = 3, it turns out that the best constant in (7.35) is 
obtained when a = 0.25 which gives C(G) = 0.1156, the constant found by Lieb. It was 
explained in Section 7.3 that this choice of G is optimal. 


The approach above applies to many operators of Mathematical Physics, e.g., the rela- 
tivistic Schrddinger operator, the discrete Schrédinger operator, sub-Laplacian on a nilpo- 
tent Lie group, and nonisotropic operators, the only decisive restriction being the condition 
of positivity [121]. 


7.6. CLR estimate for operator-valued potentials 


Some problems in quantum physics can be reduced to Schrédinger-type operators acting 
not on scalar-valued functions but on finite, and even infinite-dimensional vector-valued 
functions. Some of such problems arise when considering the Born—Oppenheimer approx- 
imation for systems containing both heavy and light particles (see, e.g., [43]), others are 
obtained from the scalar systems by separation of variables. A natural question is how 
to obtain eigenvalue estimates for such operators. Even for operators acting on functions 
with a finite-dimensional space of values, it is important to have eigenvalue estimates not 
depending on the dimension of this latter space. 

Hundertmark [55] has shown that Cwikel’s proof of the CLR estimate can be adapted to 
the following operator-valued setting. 

Let G be a Hilbert space with norm || - ||g, scalar product (-,-)g, and let 1g be the 
identity operator on G. Let L4(IR?, 6"(G)) be the space of operator-valued functions f 
whose norm 


I Fllgr = Fhe ed.er@y = if tea (| Fax 


is finite; G” is defined in Section A.8. 
Hundertmark obtained the following result. 


THEOREM 7.14 (Cwikel’s inequality, operator-valued case). Let f and g be operator- 
valued functions on an auxiliary Hilbert space G. Assume that f € L1(R4, 64(G)) and g € 


L4,(R¢, B(G))) for some q > 2. Then f (x)g(—iV) is a compact operator on L?(R4,G). 
In fact, it belongs to the weak operator ideal of, (L2(R¢, G)) and, moreover, 


| FeV) [5 = sup k4 He F@g(-1V)) <Kglifllagligigw. (7:36) 


where the constant Kg is given by 


8 1—2/q 2 1/q 
i eny#ed( (: + ) ' (7.37) 
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As in the scalar-valued case, the CLR estimate is an immediate consequence of Theo- 
rem 7.14; in the operator-valued setting it takes the following form. 


THEOREM 7.15. Let G be some auxiliary Hilbert space and let V be a potential with 
Vi € LY? (R4, 64/2(G)). Then the operator —A @ 1g — V has a finite number N of 
negative eigenvalues and the following estimate holds 


NO;-A@1g—V)< caf tig VE"? dx. (7.38) 
Rd 


7.7. Generalizations to variable coefficients 


A natural generalization of the CLR estimate, with the Laplacian replaced by the Laplace— 
Beltrami operator (2.1) on a manifold M with a metric g, would have the form 


N(0;-Ag-V)< cf Vi (x)? ue (dx), d >3, (7.39) 
M 
where jug (dx) is the Riemannian volume, 


[ug (dx) = (det g)'/* dx, (7.40) 


in local coordinates. There is no hope that this estimate holds for all manifolds, in particu- 
lar, it surely fails for compact manifolds, for which even the smallest positive V produces 
at least one negative eigenvalue. 

However, in the case of the Euclidean space with a nonstandard metric, certain results 
can be obtained. In principle, all methods proving the usual CLR estimate, might be used 
to handle (7.39), with exception of Cwikel’s one, the latter being too closely related to the 
Euclidean structure of R¢. The initial approach, originating in [16], used by Rozenblum 
to prove the CLR estimate (see [116], and modern presentations of this method in [99] 
or in [119]) can be applied to handle this problem. The idea of the approach lies in con- 
structing a subspace £ of proper co-dimension, on which the ratio of quadratic forms cor- 
responding to the two terms in —A, — V is less than 1, 


[veoluougan < f |Veul"wg(dx), ueLl\ {0}, (7.41) 
R¢ R¢ 


where |Veul? = | do glk 0;u 0xu|. As soon as such a subspace is constructed, the co- 
dimension of £ gives, according to Glazman’s lemma (see Section A.9), an estimate 
from above for the number of eigenvalues above | of the operator defined by quadratic 
forms in (7.41). The Birman—Schwinger principle then immediately leads to estimates for 
N(O; —Ag — V). Hence, the problem lies in constructing such subspaces. In fact, it is a 
problem in approximation theory. One can understand £ as the orthogonal complement to a 
finite-dimensional subspace K (it is the dimension of this K that is the co-dimension of £). 
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Thus the estimate (7.41) simply measures how good arbitrary functions with controlled 
f |Veul7 ie (dx) can be approximated by functions in K in the metrics of the space L? 
with weight V. In [116] K was taken as a linear span of characteristic functions of a cer- 
tain system of cubes, so in this case the approximation method was piecewise constant. 
A concrete realization of this idea involves obtaining Poincaré-type estimates in cubes, 


i V(x)|u(x) — wo|"Wg(dx) < C(V, g, O) i, |Veu|" Hg (dx), (7.42) 


where ug is the mean value of u over the cube Q. Combinatorial-geometric considerations 
then provide us with a system & of cubes, covering some compact part $2 in R¢ with finite 
multiplicity, so that the constant C(V, g, Q) has the order 1 for Q € &. Outside 92, V is 
“small”: Jra\e V ul? We(dx) <e Jra\e |V,u|?12(dx). After this construction is done, one 
takes as K the space spanned by the characteristic functions of the cubes Q € @. In the 
original realization in [116] (see also [99,119]), the Hélder inequality and the Sobolev 
embedding theorems were used to establish (7.42). Applied to our concrete situation, one 
obtains the estimate 


N(O;—Ag—V) 


1/p 1/q 
< c( Viera? ax) (/ w(x)~44/? ax) » aes: (7.43) 
R¢ R¢ 


for arbitrary p,q > 1, p~!'+q7!=1, where w(x) is the smallest eigenvalue of the ma- 


trix gjx(x). Thus possible cancellation of singularities of g and V at finite points or at 
infinity cannot be taken into account. Another shortcoming in (7.43) is that it involves the 
smallest eigenvalue of the matrix gj, and not the determinant, as one would like to have, 
thus weakening the result for nonisotropic metrics. 

Fefferman in [42] initiated the use of advanced methods of harmonic analysis, more 
exactly, the theory of singular integrals, to establish inequalities of the form (7.42) with 
better control over constants. He has also improved the combinatorial-geometrical consid- 
erations. Further developments (by Chanillo and Wheeden [23] and Tachizawa [145]) led, 
in particular, to estimates of the form 


N(Q;—-A,—-V)< 2) Vi (x) w(x) 4 dx, d >3, (7.44) 
Rd 


under some mild conditions imposed on w(x): this function must belong to the A2 class 
of Mackenhoupt and satisfy a certain reverse Hélder inequality — see [23] for details. Say, 
functions having power-like singularities satisfy these conditions. In particular, if the met- 
ric is isotropic, that is, the matrix gj,(x) is a multiple of the identity matrix, (7.44) turns 
into (7.39). 

We note here that this approach generalizes successfully to operators of higher order; 
this involves piecewise polynomial, instead of piecewise constant, approximation. Such 
a generalization is impossible for the methods using the heat kernel analysis: they rely 
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heavily on positivity (or positive domination) of the kernel, which always fail for higher- 
order operators. 

The recent progress in eigenvalue estimates on general manifolds is related to new results 
in the heat kernel analysis. On the one hand, for a manifold (M, g) with a nonnegative 
Ricci curvature, the heat kernel Q(t, x, x) is estimated in terms of the volume of geodesic 
balls B(x, t) with centrum at x and radius t!/? (see [24] and literature therein), 


OGED<CBET IT: (7.45) 


Setting this estimate into Theorem 7.11, one obtains an eigenvalue estimate for the 
Schrédinger operator. This estimate, generally, does not have CLR-form, since one does 
not have at present any estimates of volumes of balls in terms of the metric tensor g. 

Another recent development, generalizing the method of Li and Yau, can be found in the 
work by Grigor’ yan and Yau [50]. Being customized to the case of a geometrical operator 
(the work, actually, deals with an abstract setting of operators defined by Dirichlet forms) 
the result of Grigor’ yan and Yau is the following [50], Theorem 4.3. 

Let be a measure on M, absolutely continuous with respect to the Riemannian mea- 
sure, and let a(x) be a positively definite matrix depending continuously on x € M. 


THEOREM 7.16. Suppose that for some b > 0, p > 1 and for any open set 82 C M, the 
estimate 


i Vgul*Hg (dx) > bu(a@)'/? i |u|? 4g (dx) (7.46) 
Q Q 
holds for any u € C5? (2). Then, for a nonnegative function V, 


Loess : dye 
v(o = VG Ve) — v) <cb ah VP ug(dx), mi= djtg (7.47) 


The main ingredient in the proof is the fact that the condition (7.46) implies rather de- 
tailed heat kernel estimates for the operator — ove (a°V.). 

For the case of the Euclidean space, (7.46) is obtained easily from the Sobolev inequality 
and the Hélder inequality and this produces again the estimate (7.43). Establishing (7.46) 
in more general situations will lead to a progress in proving (7.44). 


8. Lieb-Thirring inequalities 
For y > 0, we consider the sum 


SyaVih)= D> |EjI", (8.1) 
E;<0 


where FE; = E;(V; f) denote the negative eigenvalues of Hy = —h? A — V. Obviously 
So(V; 4) = N(O; Hy). By generalizing the reasoning leading to (1.1), one expects that 
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bounds on the moments Sy,q(V; fi) expressed in terms of the phase-space volume exist, 
1.€., 


Sy,d(V3 A) < Ry,aSy q(V; hi), (8.2) 


where Ry, q are (optimal) constants and 
Si a(V3h):= (2nh)~¢ II | H (x, &)|” dx dé 
{(x,§)|H (x,€) <0} 
aL ah “[ Vi (xy 747? dx (8.3) 


with 


riyv+)l) 
24 n4/2T(y +14+d/2) 


ies (8.4) 


being the classical constant, when h = | we set Sy,q(V) := Sy,a(V; 1). The word “classi- 
cal” is explained by the relation to the eigenvalue asymptotics (1.3). Using Lemma A.5 (in 
Section A.9) we find that 


[o,@) 
Sy,a(V;h) = y / EY~'N(0; H_r+v(h)) dE 
0 
[o,@) 
=y i; E’-'N(Q; Hy—e+v))dE,  g =P. (8.5) 
0 
Substituting instead of N (0; H,(_z+v)) its asymptotical expression (1.3), we arrive at 
Sy,a(V;h)=(1+0())S) (Vin) ash 0. (8.6) 
In particular, the question arises, for which values of y and d does the inequality 
Sy,aV3h) < Sia V3 h) hold for all V? 
8.1. Admissible values of y and results 
It is well known that any arbitrary small attractive potential well has at least one bound 
state in low dimensions d = 1, 2 [14,132]. Thus, the quantity So. ¢(V), being the number of 
negative eigenvalues, is a positive integer for any nontrivial nonnegative V. On the other 
hand, the phase-space volume So, q(V) can be made arbitrary small and, consequently, 


we cannot estimate So,g(V) from above by So, q(V). Moreover, we can rule out the case 
0<y <1/2,d=1, because the unique weakly coupled negative eigenvalue obeys [132] 


(—E.(V; hy)" = (2-1 +00) a7 ' [ venas as h > 00, (8.7) 
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which shows that S)1(V; 1) = O(A~7”) for large ii, while sy (Visi= O(Ag!). 
In 1975, Lieb and Thirring proved the following result for the cases y > 1/2, d = 1, and 
y > 0, d > 2 [84,85]. 


THEOREM 8.1 (Lieb-Thirring inequality). Let E; < Ez <--- <0 denote the negative 
eigenvalues of Hy = —h? A — V in L?(R®). Then the inequality 


San < Dyan’ [ (VEG dx (8.8) 


holds for suitable constants Ly q if and only if 


yo1/2 ford=1, 
y>Oo0 ford=2, (8.9) 
y >0 ford >3. 


Note that the right-hand side of (8.8) has the correct order of the semiclassical Weyl- 
type asymptotics (8.6). In comparison to the latter, however, the inequality (8.8) is uniform 
in i > 0. This enables one to obtain information on the negative spectrum of Schrodinger 
operators from the classical considerations also in the nonasymptotical regime. 

Lieb and Thirring applied (8.8) to give a proof of stability of matter within nonrelativis- 
tic quantum mechanics [78,84,85]. Their proof of (8.8) proceed by establishing an upper 
bound to N(—E; Hy) using their generalization of the Birman—Schwinger principle, The- 
orem 7.3, in combination with the bound (7.6). The result then follows from Lemma A.5 
in Section A.9. 

For values of d, where the CLR estimate is valid, the Lieb—Thirring inequality can easily 
be derived from it: 


Cc 
Sy,dV) = eal #{Ej(V) <—t}1”—! dt 
0 
(oe) 
ay} So.a(V —t)t’—! dt 
0 


[ee 
< Roar f S§.q(V — tt”! dt 
0 


et dx d 
amar {Uff elena 
0 H(é,x)<—t (27) 


= Ro,aS°4(V). (8.10) 


Even here it does not give the optimal constant. For d < 2, however, the latter approach 
does not work and progress is thus not related to (8.10). 
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The case y = 1/2 and d = 1 was treated by Weid] [153]. In fact, Weidl obtains a two- 
sided estimate 


Sh4V) < Sia1(V) <28fj9(V), V>20VEL'R). (8.11) 


The optimal constant in the upper estimate was established in [57] and it seems that the 
optimal lower estimate in (8.11) was first noted in [49]. By comparing the weak and the 
strong coupling constant behavior one easily sees that y = 1/2 and d = | is the only case 
in the Lieb—Thirring scale, where one can express such two-sided estimate via the phase- 
space volume. 

It is worth to mention that the lower estimate in (8.11) implies that (see [49]) 


S0,2(V) = Sp..(V) (8.12) 


for nonnegative spherical symmetric V in two dimensions. Furthermore, for d = 2 the 
negative spectrum of Hy is infinite for any nonnegative potential V € Ei Nhs Le., when 
So2(V) is infinite [153]. An interesting open problem is to find out in which way (8.12) can 
be extended to a larger class of potentials. This calculation can be also successfully re- 
peated, with the Laplacian replaced by any other operator, for which the CLR estimate is 
known. In particular, if applying here the estimate (7.44) for the Laplacian on R@ with a 


non-Euclidean metric, we obtain 
Sy.a(g. V)<C / Vi GW on) dey dS, 
Rd 


where S),a(g, V) is the Lieb—Thirring sum for the operator —A, + V. Results of this kind 
were recently obtained by Tachizawa for certain degenerate elliptic operators [145]. 


8.2. Optimal values of the constants Ly,a 


An important, and still partially open problem is to determine the optimal value of the con- 
stant Ly q, especially to determine those cases in which Ly q = L q: in other words, when 
Ryd =Lya/ Ly, q = |. In fact, in the study of the stability of matter the numerical value 
of the constant L,,¢ is compared with fundamental physical constants, so exact knowledge 
of L,,q may decide the fate of the Universe. 

By an argument similar to the one leading to (8.10), Aizenman and Lieb showed that 
R,,q is a monotonically nonincreasing function of y [7]. 


THEOREM 8.2. If R,q is finite for some d and some y 2 0, then 
Ry a <Rya_ forall y'>y. (8.13) 


The results in dimension d = | are the most detailed ones. Optimal constants were ob- 
tained already in [7,85], wherein it was shown that 


Ry1=1 forall y > 3/2. (8.14) 
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Since the asymptotical behavior (8.6) entails 
Rya21 (8.15) 


for admissible pairs y and d, the constants (8.14) must be sharp. 
In the case y = 1/2, Hundertmark, Lieb and Thomas [57] showed that 


R121 =2 (8.16) 


by means of a monotonicity principle for partial eigenvalue moments of the modified 
Birman—Schwinger operator (7.7); the constant (8.16) reflects the weak coupling limit be- 
havior (8.7). Furthermore, if V(x) = 6(x) then Hs has the unique negative eigenvalue 
E,(5) = —1/4. Up to translation and scaling this is the only potential for which the con- 
stant (8.16) is achieved [57]. 

In the case 1/2 < y < 3/2, an analysis of the lowest bound state shows that 


Ry i= 


SyV) S (=A1(V))” =2( = | 
verrsi2 SV) ~ verrnn SOV) \y 41/2 


(8.17) 


The maximizing potential is 


1 
Vx= (»? _ i) cosh? x. 


Lieb and Thirring conjectured in [85] that R,,1 is actually equal to the numerical factor on 
the right-hand side of (8.17). The result (8.16) in combination with (8.13) implies at least 
Ry,1 <2. But the sharp values of Ry; remain unknown. 

Another case where the Lieb-Thirring inequalities can be tested by direct calculation is 
the harmonic oscillator. 


THEOREM 8.3. For the harmonic oscillator Vz = A — Se a= (dq,...,Qq), 
ax > O and A > 0, the inequality 


Sy,d(Va) < Sy q(Va) (8.18) 
holds for ally > 1 andalld EN. 


For the dimension d = | this can be shown by direct computation in conjunction with 
the Aizenman-—Lieb argument. The reasoning in higher dimensions d > | is more involved 
and has been carried out by De la Bretéche [30] and Laptev [68]. 

The harmonic oscillator provides also illuminating counterexamples. Indeed, one can 
show that if y < 1 then for certain parameters A and a the inequality S,¢(Va) > Dy a(Va) 
is valid [52], and hence 


Rya>1_ forally <1,deéEN. (8.19) 
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Further analysis, see [77,85], shows that for d = 2 the inequality (8.19) holds for all 
y < yo © 1.16 and it also gives some explicit upper bounds for the constants Ry, q. 

Until recently the following Lieb-Thirring conjecture posed in [85] was completely 
open. 


CONJECTURE 8.4. In any dimension d there exists a finite critical value y.,(d) such that 
Ry,q =1 forall y > yer(d). One expects that yer(d) = 1 for d > 3. 


One of the most important cases for applications is y = 1, d = 3, for which the latter 
conjecture would imply, via a duality argument, that the kinetic energy of fermions is 
bounded below by the Thomas—Fermi ansatz for the kinetic energy, which in turn has 
certain consequences for the energy of large Coulomb systems [77,84], a topic of much 
current interest. The latest essential progress here is related to considering Lieb-Thirring 
inequalities for operator-valued potentials. 


Lieb-Thirring inequalities for operator-valued potentials. In a breakthrough paper 
Laptev and Weidl [69] showed that, at first sight, a purely technical extension of the 
Lieb-Thirring inequality from scalar-valued to operator-valued potentials first suggested 
by Laptev [67] is a key in establishing at least a part of the Lieb—Thirring Conjecture 8.4. 

Their setting is as in Section 7.6: let G be a separable Hilbert space, let 1g be the identity 
operator on G and let V be a function on R¢ with values being self-adjoint operators V (x) 
in G. 

Let {E;(V; /)} denote the negative eigenvalues of the operator Hy 7; = —h’A ® Ig - 
V(x) acting on L?(R“) ® G. Moreover, let 


Sy,a(V; A) = tey2@gayqg[H_-(V; A)]” =) | EV; A)|” 
j 


and 


ake aD) =a trg[ H_(é, x)]” a = 15,40 [wg Vz (x) 4/ de, 


where H(é, x) = \é|? @ 1g — V(x) and trg| H_(&, x)]” is the Lieb-Thirring sum for the 
operator H(é, x). Define 


R 4 = sup Sya(V; h) 
ty LE gh f trglVs ta? de 


Laptev and Weid1 obtained the following generalized Lieb—Thirring inequality [69]. 
THEOREM 8.5 (Lieb-Thirring inequalities, operator-valued case). The inequality 


Sy,a(V; h) < Ry.aSe (V5 A) (8.20) 
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holds with 


Rya=Rya=1 (8.21) 
whenever y >3/2anddéEN. 


The latter confirms the first part of the Lieb—Thirring conjecture with y < 3/2. The 
crucial observation made by Laptev and Weid1 was that this extension of the Lieb—Thirring 
inequality enables one to perform an inductive proof for R3/2,¢ = 1 as long as one has the 
a priori information R,,; = | for operator-valued potentials. 

For the physically most important case y = | and d = 3, the best-known estimate was 
R13 < 5.24 [19] until Hundertmark, Laptev and Weid] [56] obtained the following im- 
provement by using arguments similar to the ones in [69] in combination with ideas in [57]. 


THEOREM 8.6. The inequalities 


a 4 for\/2<y <1, 
Ryd < Ryd < (8.22) 
2 forl<y <3/2, 
are valid for all d € N. In particular, if d = 1 then 
R121 = Ry21 =2 fory =1/2, (8.23) 
Ry ac Ry <2 for1/2<y <3/2, (8.24) 


where Ryd is defined in (8.20) and its relation to R,,q is given in (8.21) provided y > 3/2. 


Unlike the scalar-valued case, the range of parameters y and d for which (8.20) holds 
is not known. Theorem 8.6 shows only that these inequalities are true for y > 1/2 and all 
d €N. This shortcoming arises from the very way the Lieb—Thirring inequalities are shown 
for operator-valued potentials. First, the inequality is justified for d = 1 (for this case, 
an elementary proof based on the Darboux transformation was later found by Benguria 
and Loss [11]). Then the induction on dimension is used with the one-dimensional result 
applied both as a base of induction and on each step. This approach gives good estimates 
for the coefficients R, q in the Lieb-Thirring inequality, for instance, they do not depend 
on the dimension. Moments for y < 1/2, however, cannot be estimated via this technique, 
since the one-dimensional estimate fails already in the scalar-valued case. 


REMARK 8.7. The method of [85] extends to systems and verifies (8.20) for y > 0 if 
d >2 and for y > 1/2 if d= 1 with the same upper estimates on the constants Rya as are 
obtained for R,,¢ therein. The validity of (8.20) for y = 0 and d > 3 has been established 
by Hundertmark [55]; see Section 7.6. 


Based upon the aforementioned results, Laptev and Weid] [70] formulated the following 
conjecture, which remains open. 
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CONJECTURE 8.8. The inequality (8.20) holds for all pairs y, d for which (8.2) holds, and 
the optimal values of the constants R,q and R,,q coincide. 


9. Diamagnetic properties and spectral estimates 


We pass here to the quantitative spectral analysis of operators with magnetic fields. The 
key role here is played by different monotonicities arising for such operators. 


9.1. Domination 


Given two operators S and T in L*(Q2) such that T is positivity preserving, one says that 
S is positively dominated by T (abbreviated as P.D. or, in symbols, S < T) if 


|(Su)(x)| < (Tlul)(x), we L?(2), (9.1) 


almost everywhere. If S, T are integral operators with kernels S(x, y), T(x, y), then this 
is equivalent to the inequality |S(x, y)| < T(x, y) for almost all (x, y) € Q x 24 

It is natural to pose the question: which properties of T are inherited by S? Boundedness 
is clearly inherited and Pitt [106] showed that compactness is carried over as well; we 
already used it in Section 5.5. 

Domination, however, does not imply that all eigenvalues of S$ are smaller than the cor- 
responding eigenvalues of T as the following example shows. 


EXAMPLE 9.1. Consider 


1 0 1 1 
s=(1 :) and Pol ie 


Here S has eigenvalues 1, 1 and T has eigenvalues /2, 0. 


Hence, by measuring the “quality” of an operator’s compactness in terms of the rate of 
decay of its s-numbers (or eigenvalues, if the operator is self-adjoint), one must not expect 
that S =< T implies the inequality n(A, S) <n(A, T) for the distribution functions for the 
s-numbers of S and T (see Section A.8). 

Compactness can also be “measured” in terms of Schatten ideals (see Section A.8). It 
is easy to show (see, e.g., [137]) that if the operator T belongs to the Hilbert-Schmidt 
ideal G* then the same holds for S. This statement is valid also for the classes G? consist- 
ing of compact operators for which the sequence of s-numbers belongs to /?, provided p is 
an even integer [137]. However, this does not remain true for all G?, p > 2, as Simon con- 
jectured in [137]. Indeed, Peller [105] showed that for any p which is not an even integer, 
there exist operators S < T such that T € G? but S ¢ G?. 

If we replace here G? by the class G?, (see Section A.8), then even for p = 2 (and 
p =4) such examples are found [26]. 


4For additional notions of domination, we refer to Section 9.4. 
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9.2. Diamagnetic inequality 


The study of domination (as defined above) was partially motivated by the spectral analysis 
of Schrédinger operators with magnetic fields; see Section 2. 

One of the fundamental facts for Schrodinger operators with (regular) magnetic fields is 
the so-called diamagnetic inequality. 


THEOREM 9.2 (Diamagnetic inequality). If A € i then the semigroup exp (t A) domi- 
nates the semigroup exp(tA,,), t > 0, 


efAA ofA, (9.2) 


The inequality hints that the overall effect of introducing the magnetic field is to “push 
up the spectrum” and, consequently, it implies that the free energy of a system of spinless 
distinguishable particles or of spinless bosons within a magnetic field obeying the condition 
is not smaller than without a magnetic field [133]. 

In combination with the Trotter-Kato—Masuda formula (see Theorem 9.3) it implies that 
the resolvent (or, which is equivalent, the heat semigroup) of the perturbed Schrodinger 
operator H.4 y = —A.4 — V with electric potential —V is dominated by that of Hoy. It 
might thus be very tempting to derive individual eigenvalue estimates for the magnetic 
operator from the nonmagnetic ones, using the diamagnetic inequality only. This would, 
in particular, lead automatically to estimates not depending on the magnetic field, which 
agrees with the physical intuition. The example constructed in [9], however, shows that 
even in this concrete situation switching on the magnetic field may move some eigenvalues 
in the “wrong” direction, therefore domination does not generally imply inequalities for 
eigenvalues. Obtaining eigenvalue estimates for the magnetic Schrédinger operator there- 
fore became a separate problem, and many methods used in the nonmagnetic situation did 
not work in the magnetic case. 

The diamagnetic inequality (9.2) was originally conjectured by Simon [134] as a par- 
ticular case of a general conjecture on when e~’* < e~'’. The general conjecture was 
proven independently by Hess, Schrader and Uhlenbrock [53] and Simon [135] providing 
a purely functional analytic proof by relating it to Kato’s (distributional) inequality (see 
Proposition 4.4). 

There are several ways to establish the diamagnetic inequality. The proof we give here 
(first proposed in [136]) is not the simplest one but, probably, the most enlightening. It is 
based on an important abstract result from operator theory [64]. 


THEOREM 9.3 (Trotter-Kato—Masuda formula). Let S$; 20, j =1,...,k, be self-adjoint 
operators so that the sum S = S, +--+ + Sx is defined in the sense of quadratic forms. 
Then, as a strong limit, 


tS tS SEV | 
exp(—tS)=s— lim leso( ' exp( 2) .--exp(—) | : 
n—-> oo n n n 


Schrédinger operators with singular potentials 475 


Now we are able to prove Theorem 9.2. For j fixed, define 


Xj 
WI) = WO jenna = f Aj(1,...,8,..., Xa) dé. 
Then 
ei ajel¥) = 4; = 9; +i4;. (9.3) 


This is a formal relation, however under the condition y; € Tas the equality (9.3) holds 
in the rigorous sense: the maximal operators on the left-hand side, resp. right-hand side, 
of (9.3) are self-adjoint and have the same domain. Thus the operator —A_4 can be rep- 
resented as a sum (in the sense of quadratic forms) of operators —3?. Therefore we may 


apply Theorem 9.3 to express the semigroup generated by —A.,, 


t\. t PVN? 
ef44 = lim ie ui( Je wun( ©) ua £)e) (9.4) 
noo n n n 


where Uj; (t) = ef? . Now note that each U;(t) is an integral operator with positive kernel, 
and the expression in (9.4) is a composition of several (rather many) such operators and 
multiplications by functions having absolute value 1. If we replace these exponents by their 
absolute value, in other words delete them, the value of the integral can only increase, and 
this gives |e'44 (x, y)| <e’4(x, y) as we need. 


9.3. Semigroup domination criterion 


A different way of establishing domination, found in the 1970s, is based on the Kato 
inequality in Proposition 4.4. A development of this method, enabling one to consider 
quadratic forms rather than operators, was proposed by Ouhabaz [104]; this technique per- 
mits one to handle more singular cases than A € ie 

Let s be a sesquilinear form which satisfies 


(gs) is dense in L? (R‘), (9.5) 
Ns[u,u]>O Vue D(s), (9.6) 
|slu, v]] <Cllullsulls VYu.ve D(s), (9.7) 


where C is aconstant and ||u||; = /Jts[u, uv] + ||u||2, and moreover, 


(D(s), l| - Ils) is a complete space. (9.8) 


DEFINITION 9.4. Let K and L be two subspaces of L?(R“). We shall say that K is an 
ideal of £ if the following two assertions are fulfilled: 
(1) wu EK implies |u| € L. 
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(2) Ifu eK and ve £ such that |v| < |u| then v- signu EK. 


Let s and t be two sesquilinear forms both of which satisfy (9.5)—(9.8). The semigroups 
associated to corresponding self-adjoint operators S, T will be denoted by e~'* and e~'7, 
respectively. The following result was established by Ouhabaz [104], Theorem 3.3 and its 
Corollary. 


THEOREM 9.5. Assume that the semigroup e~"" is positive. The following assertions are 
equivalent: 

(1) eS xe"? forall t > O and all f €H. 

(2) D(s) is an ideal of D(t) and 


Ks[w, |v] sign] > t[ |u|, |vl] (9.9) 


forall (u, v) € D(s) Xx D(H such that |v| < |u|. 
(3) D(s) is an ideal of D(t) and 


Rs[u, v] > t[|ul, lvl] (9.10) 
for all u,v € D(s) such thatu-v >0. 
In particular, one gets 
SEPD(T) = > {(Su,u) > t[Iul, |u|] for any ue D(S)}. (9.11) 
By means of Ouhabaz’ criterion, Melgaard, Ouhabaz and Rozenblum have shown that 
the diamagnetic inequality is valid for the Friedrichs extension of the Aharonov-Bohm 


Hamiltonian [98]. 


THEOREM 9.6. Let Aap be the Aharonov-Bohm vector potential given in (3.7). The 
Aharonov-Bohm Hamiltonian —Ayp = —(V +iAap)* in L?(R*) obeys 


ef AAB < eA. 


Note that the result does not follow directly from the known diamagnetic inequality 
since the components of the Aharonov-Bohm vector potential do not belong to ‘eae this 
latter condition is crucial in all previously existing proofs of the diamagnetic inequality. 
The proof in [98] carries over to an arbitrary system of Aharonov-Bohm magnetic fields 


placed at the points of some discrete set in the plane, e.g., a lattice (see also Section 9.5). 


9.4. Diamagnetic and paramagnetic monotonicity 


A drawback of the diamagnetic inequality is that it only allows one to compare the two 
extreme cases, namely with or without magnetic field. It does not provide control when a 
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magnetic field is varied (pointwise) from a given nonzero value to another nonzero value. In 
this section we shall see that diamagnetic monotonicity and, in the case of Pauli operators, 
paramagnetic monotonicity, in this broader sense are much more difficult to obtain and 
they are even wrong in general. 

Due to the nature of the questions (and answers) addressed here, it is convenient to 
change slightly our notation for magnetic Schrédinger operators and Pauli operators. 
Throughout we emphasize the dependence of the magnetic field by setting 


Hgy =—-Ajat+V and 


Pav =[o-(V+tiA]+V 


where B = dA is the (2-form) magnetic field and V is the electric polenta The pointwise 
strength of the magnetic field is defined as [B(x)]| := tr|A(x)| = W47! 1g, (x)|, where 
&(x) is considered as a real skew- Somer matrix with entries (Bae, en )YS pa 1= 
{Bjx(x)} (for any orthonormal basis {ex}4_ ,) with eigenvalues +if,(x) (in odd di- 
mensions there is an extra zero eigenvalue). Here [-] denotes the integer part. Further- 
more, the local energy norm of the magnetic is defined as ||B(x)||2 = (tr|A(x)|7)!/? = 
(2>-,,—1 [Bn (x) }?)'/?. Note that [B(x)] = ||B(x)||2 for d = 2, 3. 

For potentials Vj, V2, being just real-valued functions, domination is easily introduced 
as a (partial) ordering: we say that V; is smaller than V2 if Vj(x) < V2(x) holds for all 
xeR?. 

Domination for magnetic fields, on the other hand, can be ordered in three ways, 
at least. First, we say that B; is smaller than Bz in the sense of pointwise strength if 
[Bi (x)] < [Bo(x)] for all x € R@. Second, By, is smaller than Bz in the sense of local 
energy norm if ||B\(x)|l2 < ||B2(x)||2 for all x € R¢. Third, B, is smaller than Bo as a 
2-form if | A, (x)| < |A2(x)| as nonnegative matrices for all x. Observe that all three types 
of domination coincide in d = 2 and in d = 3 provided the magnetic fields have constant 
direction. The first two notions coincide in d = 3 for any field. 

We list next some possibilities to say that an operator T dominates S defined by means of 
various (partial) orderings of self-adjoint operators (assuming that both are semibounded, 
defined on L?(R¢) and the kernels below exist).> 

(D.1) S < T. (Operator sense.) 

(D.2) |exp(—tT)(x, y)| < |exp(—tS)(x, y)| Vx, y € R?,+>0. (Heat kernel point- 

wise.) 

(D.3) exp(—tT)(x,x) < exp(—tS)(x,x) Vx,y € R?,t>0. (Heat kernel diagonal 

pointwise.) 

(D.4) trexp(—tT) < trexp(—tS) Vt > 0. (Trace of heat kernel.) 

(D.5) info(S) < info (T). Unfimum of spectrum.) 

(D.6) |lexp(—tT)|lp.q < llexp(-tS)llp.q, 1 < p <q < oo. (Heat kernel L? > 

L4-norm.) 


5For the Pauli operator one always consider the partial trace tr,2 with respect to the spin variables to reduce it 
to an operator on L2(R¢), 
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Evidently these definitions are related. Some of them imply some of the others, e.g., 
(D.2) > (D.3) > (D.4) => (D.5). Within Physics, (D.1), (D.4) and (D.5) are the most 
significant. 

If the magnetic field equals zero, then the following classical result says, roughly, that 
the energy increases as the electric potential increases; the result is most easily shown by 
means of the Trotter—-Kato formula. 


PROPOSITION 9.7. In any dimension, if Vj < V2 pointwise, Hy = —A + V2 dominates 
AH, =—A+ V;, in the sense of (D.1)-(D.6). 


The search for analogous statements in the case where the magnetic field increases may 
be guided by the following loosely formulated conjectures. 


CONJECTURE 9.8. (i) Diamagnetic principle: The Schrédinger operator “increases” as 
the magnetic field increases pointwise. 

(ii) Paramagnetic principle: The Pauli operator “decreases” as the magnetic field in- 
creases pointwise. 


Several arguments support these conjectures, the simplest one based upon explicit for- 
mulas for the diagonal element of the corresponding heat kernel for a constant magnetic 
field and zero potential. We will see below that both statements are true in the “short time” 
limit for the heat kernel limit (i.e., for small f) and, equivalently, in the semiclassical limit 
h — 0. For the Schrédinger case, it is even true in the strong field limit where Br> wB 
and jz — oo. It turns out, however, that if no limiting procedure is involved then none of 
these conjectures are correct unlike the nonmagnetic case. 


Magnetic Schrodinger operators. If both B, and Bz are constant and V = 0, then the heat 
kernels can be compared explicitly, since they are given by Mehler’s formula (see [138]), 
and one easily sees that domination in the sense of (D.2) (hence also (D.3)-(D.5)) follows 
if the fields are ordered in the sense of 2-forms. Due to the lack of positivity, however, the 
domination (D.6) is not trivial. Nevertheless, Loss and Thaller [86] managed to show that 
the domination (D.6) follows under certain conditions on p, g and By. 

Next we turn to the case of nonconstant fields B, and Bz obeying that B; is “smaller” 
than B> in some of the aforementioned senses. An obvious simplification is to introduce a 
coupling parameter in the magnetic field, viz. HyuB.o = —AyA = (V +iA)?, and consider 
the weak and large field limits (u — 0, u — oo). 

We consider first the short time case with ||B(x)||2 determining the ordering and we 
impose the constraint ty. — 0. In particular, this covers the semiclassical limit with t =: 
Bh?, 1 =h—', where B is the “inverse temperature”. 

The following result, obtained by Erdés, shows that Conjecture 9.8(1) is valid in the short 
time (large temperature) limit. In other words, domination (D.3) and (D.4) are valid [35], 
Corollary II.2. 
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THEOREM 9.9. If the magnetic fields B, and Bz with finite C!-norm satisfy ||Bi(x)|l2 < 
||B2(x)|l2, V is semibounded and continuously differentiable, then for any x € R*, 


ef tuBL.V (x, x) — ef AuB2.Y (x, x) 


> C(x) (4nt) eV 7 4?(|[Bo(x) | 5 — Bi G5) > (9.12) 


for some C*(x) and for small enough tu < €9, t < &0, where eo, C*(x) > 0 depend on 
the C!-norms of B, and Bo, on Vo = MIN, Rd V(y) and, moreover, C*(x) depends on 
maxy: jy—x|<1|WV(y)|. Jf, in addition, fexp(—tV (x)) dx is finite for all t > 0 and the 
C!-norm of V is finite, then the domination (D.4) is valid as well for small enough t. 


Next we consider the large field limit 44 — oo for which Erdés obtained the following 
result [35], Theorem IL.8. 


THEOREM 9.10. Suppose that B, and By are two C! fields obeying 0 < [B,(x)| < 
[B2(x)| and let V be a smooth semibounded potential. Then the domination (D.4)-(D.6) 
are true for the operators Hy = Hyg,,v,1 = 1,2, in the 4 > o limit; for (D.6) one needs 
the additional requirement that exp(—t(—A + V)) is in trace class for all t > 0. 


Next the question arises whether these conjectures are true without any limiting proce- 
dure. It suffices to consider dimension two. We define the ground-state energy, 


E(B, V) := info (Hp,y) = ia Te (w, Hp vy). 


The following counter-intuitive examples proposed by Erdés demonstrate that the general 
form of the Conjecture 9.8(i) is wrong [35]. 


EXAMPLE 9.11. There exist a potential V (in fact, centrally symmetric such that |x| te 
V (|x|) is decreasing outside some compact set) and two constant magnetic fields such that 
0 < By < Bo but Eo(Bo, V) < En(B1, V). 


EXAMPLE 9.12. There exist two nonconstant centrally symmetric magnetic fields obeying 
0 < By(x) < Bo(x) forall x € R? but Eo(B2, 0) < Eo(B1, 0). 


These counterexamples, in particular, show that the domination in the sense of (D.5) 
cannot be true, which excludes also domination in the sense of (D.2)—(D.4). 

Nevertheless, as shown by Leschke, Ruder and Warzel [73], Theorem 1, one can restore 
domination in the sense of (D.5) if the ground-state wave function in the Poincaré gauge is 
real. Indeed, in Examples 9.11 and 9.12 the ground-state wave function yo of Hg,,y,, in 
the Poincaré gauge, 


1 
A(x) = (-xa.ap [ 6 Bx(ox) dé, (9.13) 
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is an eigenfunction of the canonical angular-momentum® L3 := q1 p2 — q2P1 operator with 
a nonzero eigenvalue. Thus wo is not real-valued, which motivates the additional assump- 
tion in the following result [73], Theorem 1. 


THEOREM 9.13. Let the Schrédinger operator Hpg,,v, in the Poincaré gauge (9.13) 
possess a real-valued ground-state wave function, i.e., Eo(B2, V2) = (Wo, HB,,v, Wo) for 
some Wo in the domain of Hp, y, with || wo|| = 1. Then the pointwise inequalities |B\(x)| < 
|Bo(x)| and Vi (x) < V2(x) forall x € R? imply the inequality 


Eo(Bi, Vi) < Eo( Bo, V2) 
for the corresponding ground-state energies. 


As mentioned above, Loss and Thaller studied domination in the sense of (D.6) asso- 
ciated with a nonconstant field B(x) which is globally bounded from below by a positive 
constant. In particular, they have shown the following inequality [86], Theorem 1.3. 


THEOREM 9.14. Suppose that B(x) > Bo > 0 is continuous. Then the magnetic heat ker- 
nel satisfies the estimate 


B 
FER 29 Sper tee a ae (9.14) 
4n sinh(Bot /2) 


Erdos showed that (9.14) is basically the best “off-diagonal” upper bound one can hope 
for, unless B : R? > R has additional properties. More exactly, he proved that (9.14) cannot 


be sharpened by replacing its right-hand side by |e ‘ HB (x, y)|, which has faster Gaussian 
decay as |x — y| > oo [35]. 


EXAMPLE 9.15. Define B(x) = (1+ x7/b?)Bo with two constants Bo, A > 0. Then there 


exist some A > 0, some x, y € IR? and some Bo > 0, such that Bp < B(x) for all x € R?, 
but |e’”8 (x, y)| > |e’780(x, y)|. 


It is, however, possible to improve (9.14) at the price of permitting only a restricted class 
of nonconstant magnetic fields (including the one in Example 9.15). For a field which is 
constant in one direction Leschke, Ruder and Warzel obtained the following result [73], 
Theorem 2. 


THEOREM 9.16. Let By, Bz and V,, V2 be two magnetic fields and two potentials of which 
neither depends on the second coordinate x2. Then the pointwise inequalities |B\(x1)| < 
|Bo(x1)| and V\ (x1) < V2(x1) for all x, € R imply the inequality 


Je #82.¥ (x, y)| < |e 781-1 (x1, 0), (1, 0))| 


for all x = (x1, x2), y = (1, y2) € R? and all t > 0. 


Here gq = (41,42) and p = (/p1, p2) denote the usual two-component vector operators of position and canoni- 
cal momentum, respectively. 
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Pauli operators. For large temperature (short time in the heat kernel) the diamagnetic and 
paramagnetic effects can be compared and Erdés established the following general result 
in dimensions d = 2,3. Again, this statement includes the semiclassical result by using 
t:=Bh?, w=ho!. 

THEOREM 9.17. Suppose d = 3 and let V be a semibounded continuously differentiable 
function. Let B € C3 with |\|B||L + ||VBl|z~ < 00 and let 4 > 1 be a scaling parameter. 
For any x € R¢, one has that 


tte e!PuB.v (x, x) 


_ = tucoshtu| B(x) | 
— 2(4nt)74/2(1 + O(f5/2 12 + #44 tV (x) 
Cre eae OF abet de) sinht | B(x) | 
+ 2(ef#B-0Y (x, x) — eo fV Met HB (x, x)) (9.15) 


as t + 0 and tu — 0. The error depends on maxy: xy <i lV7B(y)| + lV>B(y)I], the 
C!-norm of B, on Vo := MIN), cpa V(y) and on maxy: |y—x|<1|VV (y)|. The same holds for 
d =2; here B(x), | B(x) is replaced by B(x) everywhere above. 


The latter implies Conjecture 9.8(ii) in the sense of (D.3) and (D.4) [35], Corollary II.2. 


COROLLARY 9.18. Suppose d =3, B,, Bz € C3 with finite C!-norms, and that V € C! is 
semibounded. For any x satisfying |B\(x)]| < [B2(x)], one has that 


tree eT PUB (x, x) — tte ef PulBy lV (x, x) 
> C* (x) (Ant) 8/20 © 7 12(| Box) |? — [Bi (x) |°) > 0 (9.16) 


for small enough ti < &9 and some C*(x), where &9, C*(x) > 0 depend on the global 
lower bound of V, on maxy: |y—x|<1 lV V(y)| + |V?B(y)| + |V>B(y)|], and on the global 
C!-norms of By and Bo. If, moreover, f exp(—tV (x)) dx < © for all t, and the C!-norm 
of V and the C3-norms of B,, Bz are bounded, then domination in the sense of (D4) 
is valid for t small enough. The same holds for d = 2; here B;(x), |Bj(x)]| is replaced 
by B;(x) everywhere above. 


An interesting open problem is to investigate paramagnetism in d = 3 for a general 
magnetic field away from the short time regime. 
9.5. CLR estimate for generators of positively dominated semigroups 
The CLR estimate for Schrédinger operators with magnetic fields takes the following form. 
THEOREM 9.19 (CLR estimate). For A € L?,.(R¢) and Vy. € L4/?(R4), 


NO;-Aa- vy <cq f vias (9.17) 
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with constant Cq depending only on the dimension. 


The first proof of Theorem 9.19, following Lieb’s method [77], was based upon the 
path integral technique [9,138]. Later Melgaard and Rozenblum [99] obtained an analytic 
proof by means of a “customized” diamagnetic inequality expressed in terms of certain 
semigroups combined with Rozenblum’s original approach. Among the applications of 
the “magnetic” CLR estimate are asymptotics of eigenvalues and stability of matter in 
magnetic fields (even in the more realistic Pauli setting, where one takes into account spin 
of the particles). 

Let S generate a positively dominated semigroup. Like in the positive case (see Sec- 
tion 7.5), suppose that multiplication by a given V > 0 is form-bounded with respect to S, 
with a bound smaller than 1. (Note that this is always the case, provided the above condi- 
tion is satisfied for the dominator 7; this is an easy consequence of (9.11).) Then we can 
define the self-adjoint operator S — V and, as above, consider the quantity N(0; S— V). 

Rozenblum and Solomyak obtained the following result [121]. 


THEOREM 9.20. Let T © P and S € PD(T). Suppose that Mr(t) satisfies (7.30) and 
Mr(t) = O(t~%) at zero, with some a > 0. Let G be a function as in Theorem 7.11 and 
let go be the constant therein. Then 


1 (dt 
N(O;S—V)< / [ mroctvonar, (9.18) 
80/0 Ff JQ 


as long as the expression on the right-hand side is finite. 


Comparing Theorems 7.11 and 9.20, we see that N(0; S— V) and N(O; T — V) have the 
same estimate. However, the natural conjecture N(0; S— V) < N(O; T — V) is, generally, 
wrong as noted in [9]. 

Evidently, Theorem 7.11 is a particular case of Theorem 9.20, for S = T. A more general 
version of Theorem 9.20 exists which does not require (7.30) [118]. 


PROOF OF THE MAGNETIC CLR ESTIMATE. For a given magnetic vector poten- 
tial A(x) = (Aj@))fa1 E L2 (R4), consider the magnetic Laplacian S$ = —Ay = 


—(V —iA)?. According to Theorem 9.2, —A 4 € PD(—A) and thus Theorem 9.20 gives 


NO:-4a-Vv)<C@) [ Vix)? dx, d>3, (9.19) 
Rd 


with the same constant as in (7.35). 


The proof of (9.19), outlined in [138], page 168, uses the stochastic It6 integral. A more 
elementary proof in [99], avoiding path integration, gives a somewhat worse constant than 
in the nonmagnetic case. 

The same scheme enables one to derive CLR-type estimates for several other operators 
of Mathematical Physics with magnetic fields [118]. 
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The proof of the diamagnetic inequality for the one-vortex Aharonov-Bohm Hamil- 
tonian (see Theorem 9.6) can be carried over to the case of finitely, and even infinitely 
many vortices (e.g., a lattice). Equipped with the latter diamagnetic inequality, Melgaard, 
Ouhabaz and Rozenblum used Theorem 9.20 to derive the Lieb—Thirring inequality, as well 
as CLR-type estimates, for the (multivortex) Aharonov-Bohm Hamiltonian. Moreover, the 
presence of special Hardy-type inequalities gives much better eigenvalue estimates than 
without magnetic fields [98]. 


9.6. Comparison theorem for semigroup generators 


We start with a general eigenvalue comparison theorem for semigroup generators. In the 
Hilbert space L*(2) we consider two positive self-adjoint operators § and T. These op- 
erators generate contraction semigroups P(t) = exp(—tS) and Q(t) = exp(-tT), t > 0, 
in L*(Q). We suppose that the semigroup Q(t) is positivity preserving and P(t) < Q(t), 
t > 0. Fora function ¢(A), A > 0, growing subexponentially, we denote by b(t) the Laplace 
transform of ¢. Such function @ is called regular if 


th(t) <Cgp(t~'), 1>0, (9.20) 
for a certain constant Cg. There are plenty of regular functions, which, obviously, form a 
convex cone in the space of functions on the semiaxis. In particular, power functions, these 


times logarithm to some power, etc. are regular. 
Rozenblum showed the following result [118]. 


THEOREM 9.21. Suppose that for the operator T the estimate 
N(QA,T)< PA) (9.21) 
holds for all . > 0, with a certain nondecreasing function (A) of subexponential growth. 
If the semigroup P(t) = exp(—tS) is dominated by Q(t) = exp(—tT), t > 0, then 
(1) the eigenvalue distribution function of S obeys 
N(A, S) <ea"$(a7'), 0<A <00, (9.22) 
in particular, for a regular function ¢, 
N(A, S) <eCgG(A), V<A<~H; (9.23) 
(ii) if the operator T~' belongs to the class 6',, 0 < p < 0, then S~! € GI, and 
IS Mee <CW)IT Ale: 


(iii) if the operator T~' belongs to the class G?, 0 < p < 00, then S~! € G? and 
IS~'ller < IIT" llee. 
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PROOF. The trace of the positive operator Q(t) can be expressed as 
oo A 
rf N(Q, T)exp(—taA)daA < tot), t>0. 
0 


Since the function ¢ grows subexponentially, this integral converges, and thus Q(t) be- 
longs to the trace class G! and, therefore, to the Hilbert-Schmidt class G? for any 
positive t. This implies that the operators P(t) dominated by Q(t) also belong to the 
Hilbert-Schmidt class for all positive t, with domination of Hilbert-Schmidt norms. Thus 


? t 
< a! 
S2 |0(5) 


Being expressed in terms of eigenvalues A; of the operator S, this gives 


2 


PQ) =|/PO|6:= |°(5) = OM < 1400. 


S 


tPW)= ye < 1g). (9.24) 


j=l 


Now, for a given positive 4, we set t = 27! in (9.24). Since the first n(A, S) terms in the 
sum in (9.24) are greater than e—!, we arrive at (9.22). The regularity condition (9.20) 
gives (9.23). Since the power function is regular, we obtain part (ii) of the theorem, 
with C(p) =er(1 + ak Finally, ||S~'||2, = ry! Jo. t!/?! trexp(—tS) dt, and sim- 
ilarly, for the operator T~!; in this way (iii) follows from the inequality trexp(—tS) < 
trexp(—tT). 


9.7. “Meta” CLR estimates for dominated pairs of semigroups 
We start with the most regular case; here it is possible to avoid troublesome technicalities 
present in the general situation. Let S and T be positive definite operators in L*(2), with 
the semigroup exp(—tT) positivity preserving and exp(—tS) dominated by exp(—tT), 
t > 0. For a nonnegative measurable function V(x), with V and V~—! both bounded, we 
define the operators T— qV, S—qV,q 20. 
Rozenblum obtained the following result [118]. 

THEOREM 9.22. Suppose that 

NO; B—qV) <¢@) (9.25) 


for all q > 0, for some nondecreasing function $(q) of subexponential growth. Then 


N@;A—qV) <eq '6(q7'), q>0, (9.26) 
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and 


[o-e) CO 
/ NO: A—qVq?-"ag < f NO; B-qV)q?-'dq, O0<p<o, 
0 0 
(9.27) 


as long as the integral in the right-hand side is finite; and if the function @ in (9.25) is 
regular, then 


N(O; A— GV) <eCy(q). (9.28) 


PROOF. We will construct semigroup generators related to our Schrédinger-type operators, 
and apply Theorem 9.21. According to the Birman—Schwinger principle, see Theorem 6.7, 


N(O; B—qV) =n(t, Ka), N(O;A—qV)=n(t, Ka), t=q'”, 
where 
Ka=Vil2A-'2 Kp=V'/*B- 1/2, 


and n(t, K) denotes the distribution function for s-numbers s;(K) of K (see Section A.8). 
Under our conditions, these operators are bounded, they are products of bounded opera- 
tors, and Kg is compact. Moreover, they have trivial kernels and therefore the self-adjoint 
compact operators Kg K* = V'/*B-!V!/? and K4K*% = V!/2A~!V'/? have self-adjoint 
positive-definite inverses Tg and T,, respectively. The estimate (9.25) can therefore be 
written as N(A, Tg) < P(A), A > 0. So, Theorem 9.21, with T = Tg and S = T, will give 
us the required estimate as soon as we show that the semigroup exp(—t7,) dominates 
exp(—t7T,4). This is equivalent to the resolvent domination 


(Ta+t) 1 < (Tet 1, t>0. 


We can write (T4 +t)! = (V7! AV! 4)! = V!/2(A4+tV)-!V!/, and a similar 
identity for Tg. Now it remains to notice that the Trotter formula implies (A + tv)! 
(B+tV)7~! and to use positivity of V. 


REMARK 9.23. The relation (9.27) can be expressed also as 
I|Kalle2 <IlKelle2, O<p<oo, 
at the same time, for the regular function ¢(¢) = qg?, (9.28) implies 
Kallen <C(Kallgz, 0<p<oo. 
Applied to Schrédinger operators, with T = —A, S = —A y, the conditions of bounded- 
ness of V and V~! are too restrictive. In a more advanced version of Theorem 9.22, these 


restrictions are removed and, moreover, V can be a measure, like in Sections 5.2 and 5.3, 
the main idea of the proof being the same [118]. 
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10. Zero modes for Pauli operator 


One of the important features in the spectral properties of Pauli operators is the presence of 
zero modes, eigenfunctions corresponding to a zero eigenvalue. This phenomenon, rather 
unusual for nonmagnetic operators, became an interesting field of research lately, both for 
physicists and mathematicians. Zero modes induce certain pathological behavior of the 
operator under perturbations by an electric potential, since the potential energy cannot be 
controlled by the kinetic one. Therefore, in particular, even a very weak electric field may 
produce an infinite negative discrete spectrum. Analysis of zero modes becomes thus a 
crucial step in the study of stability of quantum systems (see [80,87]). At the same time, 
they play an important role in quantum electrodynamics, since they produce singularities 
in fermionic determinants; see, e.g., [45-47]. In this section we discuss different situations 
where zero modes arise. We start with the most classical example. 


10.1. Constant magnetic field 


We recall that the Pauli operator with constant magnetic field in dimension d = 2 is 


0.0. 0 ) 
0 Q,Q-)” 


O+ = (0; +i1A1) +i(02 +iA2) (cf. (2.8)) with the magnetic potential A(x) having the 
form (Bx2/2, —Bx;/2). Here the field B is supposed to be positive. 

Since the zero modes y(x) are solutions of the equation P_ 4w = 0 and P, is the square 
of the Dirac operator, P_4 = D?, they must be solutions of the first-order system Dy = 0. 
We write this equation for the components w., Ww of the vector function y, arriving at 
equations 


Pa= (ov +ia)y’=( (10.1 


(01 + i102 — iA; + Az) Wy =0, 


; ; (10.2) 
(0; —id2 — iA, — A2)w_ =0, Oj = Ox;. 
Taking into account the explicit expression for A, we transform (10.2) to 
(1 + ide BAGI+D y, =0, (10.3) 
(8; —idn)e8 401) y_ =O. (10.4) 


These equations mean that the functions f+ = eFB/ ACTHD) yy are analytical in the vari- 
ables 7 = x; —ix2 and z = x1 + 1x2, respectively. Consider (10.3). Supposing that it has a 
solution ~ € L?, we obtain an analytical function f; € L7; there are, however, no such 
analytical functions. This means that (10.3) has no (nontrivial) solutions in L?. On the 
other hand, (10.4) has quite a lot of L* solutions. In fact, if f_ is any entire function of 
the variable Z growing at infinity slower than exp(|z|?~*), then the corresponding function 


wy =e B/ABT+29) f_ solves (10.4). 
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The factorization (2.8) enables one to describe completely the spectrum of P.4. This 
description is based on the commutation relation 


Q.0--Q-04 =-2Bl, (10.5) 


and the well-known fact that the operators ST and TS have the same nonzero spectrum. 
Notice, moreover, that Q- = Q*. So, Q— and, therefore, Q; Q— have zero eigenvalue. 
Since Q,Q_ >0 and Q_Q, =2BI+ Q,Q_, the operator Q_Q4 has no spectrum 
below 2B, and therefore, Q4Q- has no nonzero spectrum in [0,2B). This means that 
Q_-Q+ has no spectrum in (2B,48B) and so on. Repeating this reasoning, one can see 
that the only possible points of spectrum for Q,Q_- and Q_Q, are the points of the 
arithmetical progression 2vB, v = 0,1,2,... for Q, Q- and v = 1,2,... for O_Q4. 
Next, it follows again from (10.5) that Q_ transforms isomorphically the space of zero 
modes for Q, Q_ onto the spectral subspace of Q_ Q with eigenvalue 2B. This means, 
moreover, that Q,Q-~ also has an infinitely degenerate eigenvalue at 2B. We iterate this 
reasoning to conclude that all points 2v B are infinitely degenerate eigenvalues of P_4. They 
are called Landau levels. In a number of questions the explicit description of eigenspaces 
of P,4 is needed. We return to the study of these eigenspaces in Section 11.1. 

Infinite degeneracy of the zero eigenvalue for a constant magnetic field was known quite 
long ago. It was only in 1979 that the existence of zero modes was discovered for a non- 
constant field and, moreover, the multiplicity was calculated. 


10.2. Aharonov—Casher theorem and zero modes for d =2 


We consider the Pauli operator P_4 in R? with a magnetic potential A which, for a start, 
we suppose to be Lipschitz, such that the field B(x) = 0Aj/0x2 — 0A2/0x, decays suffi- 
ciently fast at infinity (we may even suppose that it has compact support). This does not, 
however, mean that the magnetic potential A decays at infinity, so the operator is not a 
weak perturbation of the nonmagnetic operator. 

To see that A cannot decay at infinity too fast, consider the circulation of the vector 
field A along a circle Cr with large radius R. According to the Green formula, 


A(x) dx = / B(x) dx, (10.6) 
Cr Ix]<R 
so, if the total flux of the magnetic field, 
P= en" f B(x) dx, (10.7) 
R2 


is nonzero, A cannot decay at infinity faster than C|x|~!, at least in some directions. 
It was found by Aharonov and Casher that it is this flux which determines the number 
of zero modes [6]. 
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THEOREM 10.1. Fora real number q, let {q} denote the largest integer strictly less than q. 
Let the magnetic field B have compact support. Then, the dimension of the space of zero 
modes for the Pauli operator equals {|®|}, if |®| > 0 and 0 if |@| = 0. 


PROOF. We introduce the scalar potential 


g(x) =x) a ,log(lx — yl) BO) dy, (10.8) 
which behaves like 
g(x) = Plog |x| +O(|x|7!) as |x| > &. (10.9) 


Since —(2)~! log(|x|) is the Green function for the Laplacian, g satisfies the equation 
—Ag = B, and the vector field 


A(x) = (Py, —Gx) (10.10) 


can serve as a magnetic potential for the field B. In addition, A(x) satisfies the Coulomb 
gauge div A= 0. 
Now the system (10.2) determining the zero modes can be transformed to 


(3; + ide? wy. =0, (10.11) 
(3; — ide? wy =0, (10.12) 


taking into account the expression of A via g. The reasoning follows now the pattern 
of the case of a constant magnetic field. Equations (10.11)-(10.12), being simply the 
Cauchy—Riemann equations, mean that the function f, = e~? w+ is analytical in the vari- 
able z = x1 —ix2, and f_ =e? w_ is analytical in z = x; +1ix2. Suppose that > 0. Then 
(10.9) implies that e~? is a bounded function in R*, and if w4 belongs to L*, this would 
mean that the analytical function f; belongs to L*. However, there are no (nontrivial) an- 
alytical functions in L?, and this means that (10.11) has no solutions. For y_ =e? f_ to 
be in L, the function f_ may increase at infinity no faster than a polynomial, and being 
analytical, it must be a polynomial in z and, furthermore, it must be of degree n < @ — 1, 
as seen from the asymptotics (10.9). The space of such polynomials has dimension ex- 
actly {®}, and this proves our theorem. Note, moreover, that all zero modes have zero 
components 7,, so they are “spin down’, as physicists express this. If ® < 0, the same 
reasoning works, but now it is y_ which is forced to vanish, and all zero modes are “spin 


” 


up”. 


As we see, the two starting points in the study of zero modes in dimension d = 2 are the 
constant magnetic field, with infinitely many zero modes, and a compactly supported one, 
with finitely many. A considerable work was done in order to find more general situations, 
where zero modes can be studied. 
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10.3. Zero modes for singular fields 


The conditions in the Aharonov—Casher theorem are far from being optimal. Even a su- 
perficial analysis of the proof shows that both smoothness and decay conditions can be 
considerably relaxed. Along this direction, we describe here the strongest result up to now, 
established by Erdés and Vugalter [41]. But first we must return to the problem of how to 
define a self-adjoint Pauli operator with a very singular magnetic field. This is achieved, 
again, by introducing the scalar potential and using the ideas presented in Section 3.2. 

Let B be a signed locally-finite measure on R?. A direct definition of the operator by 
means of the formulas (2.6) or (2.7), using some magnetic potential, would immediately 
require some regularity conditions on B, encountering moreover nontrivial essential self- 
adjointness questions. Using quadratic forms, as it is explained in Section 3.2, proves to be 
more efficient. 

First, supposing that B is nice and is defined by means of the magnetic potential A, we 
write the quadratic form of the Pauli operator using the factorization (10.1) and the fact 


that O* = Q1, 
palv]=pal(vs, v-) = / (\O+W4l? +|O_W_|?) de. (10.13) 


This form is well defined for wi € D(Q+), provided A € i. which gives more freedom, 
but is still a too restrictive condition. So, suppose that there exists a scalar potential g, as 
in (10.10). Then, using the complex derivatives, as we already did twice, we can rewrite 
the quadratic form (10.13) as 


Alves ela f (2 |a.(e?v)[? +e ae(e¥-)P) ax. (10.14) 


Note that the magnetic vector potential is not present in (10.14); the scalar potential g can 
be defined directly, as a solution of the equation 


=Ay=B: (10.15) 


Now, suppose that B is a signed Borel measure with locally-finite total variation. We denote 
the set of such measures by mM. If, moreover, for any point x € IR, B({x}) € (—x, x], the 
measure B is said to belong to M*. Note that points with nonzero measure correspond to 
Aharonov—Bohm solenoids placed i in these points. 

The sets of measures in IM and M*, resp., with finite global variation are denoted by 
IM and M*, resp. Two measures B, B’ are called equivalent if for any point x the differ- 
ence B(x) — Bix)* is an integer multiple of 2. For any measure B € M there exists a 
unique B’ € I* equivalent to B, the same holds also for IN and IN*. Now, supposing that 
for a given B € IM there exists a potential ¢ € jim satisfying (10.15) in the sense of dis- 
tributions, one can define the Pauli operator Pg as the one corresponding to the quadratic 
form (10.14) with domain consisting of those pairs of functions 4, y— € L* for which the 
expression (10.14) is finite. It is shown that, in fact, such a potential g always exists and, 
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moreover, it is a rather nice function: its derivatives locally belong to L? for any p < 2, and 
furthermore, exp(+29) belongs locally to L't® for some ¢ > 0. This regularity is used to 
prove that the form (10.14), thus defined, is closed and therefore determines a self-adjoint 
operator. 

The Aharonov—Casher theorem can be extended to Pauli operators defined in this 
way [41]. 


THEOREM 10.2. Suppose that the field B is a measure in IN* with finite total variation. 
Define the total flux of B as (B) = (2n)~! B(R?). Then the dimension of the space of zero 
modes associated with the Pauli operator Pg equals {(B)}, if (B) is noninteger or (B) = 0. 
Tf (B) is an integer, this dimension can be {(B)} or {(B)} — 1. 


We note that for an integer flux, both cases may occur, and the difference depends on 
the behavior of B at infinity. Moreover, an example constructed in [41] shows that for a 
measure with an infinite local variation the statement may be wrong. 


10.4. Infinite number of zero modes 


Now we discuss more examples when there is an infinite number of zero modes, as this 
is the case for the constant magnetic field. The first idea here would be to consider some 
perturbations of the constant field. As the most simple example, we consider a weak per- 
turbation of the magnetic potential, A= Ag + A’, where Ag is the potential of the con- 
stant magnetic field, Ag = (Bx2/2, —Bx,/2) and A’ > 0 at infinity. In this case the Pauli 
operator P_4 can be (using methods from Section 5) shown to be a form-compact pertur- 
bation of P_4,. According to Weyl’s theorem on the invariance of the essential spectrum 
under relatively compact perturbations (see, e.g., [155] or [114]), zero will still be a point 
in the essential spectrum of the perturbed operator. In fact, 0 is in the essential spectrum 
for QQ _; since 0 is not in the essential spectrum of Q_ Q, it is an isolated point of the 
spectrum, so it has to be an infinitely degenerate eigenvalue again. A more delicate reason- 
ing is needed if it is the magnetic field B that is weakly perturbed but the corresponding 
perturbation of the magnetic potential A is not weak. For this case the infiniteness of zero 
modes was proved by Iwatsuka [59] using a perturbation of the commutator relation (10.5). 
The situation was finally cleared by Shigekawa [127] who showed, using again commuta- 
tion relations, that there are infinitely many zero modes also in the case when B is continu- 
ous and tends to infinity at infinity; a sharp contrast to the magnetic Schrédinger operator, 
where in this case the essential spectrum is empty; see Section 6.4. 

A recent development is related to the study of zero modes for infinite systems of 
Aharonov-Bohm solenoids. Let w),@2 be two linearly independent vectors in R? and 
in each point of the lattice, Z,,.n. = 1@1 +22, an Aharonov-Bohm solenoid with a 
fixed flux a is placed. In the language of Section 10.3, the magnetic field here is a measure 
consisting of point loads with weight a placed in the points of the lattice. Since the total 
variation is infinite, this case is not covered in [41]. In [48] Geyler and Grishanov con- 
structed explicitly the vector potential A for this singular field using methods of elliptic 
functions, and an infinite number of zero modes were shown to exist. This is the case even 
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if such a lattice of Aharonov-Bohm solenoids is placed on the background of a constant 
magnetic field. 

Just recently the problem of infinitely many zero modes was settled by Shirokov and 
Rozenblum (http-//front.math.ucdavis.edu/math-ph/0501059). If the field B is nonnegative 
regular Borel measure as in [41], such that the total flux (B) of the field is infinite, then 
the space of zero modes is infinite-dimensional. This is still the case if the nonnegative 
condition is replaced by the requirement that for some R, B(Dr) > 0 for any disk Dr 
with radius R. If, moreover, B(Dr) > a > 0 then zero is an isolated point in the spectrum 
of the Pauli operator. 


10.5. Zero modes in dimension d = 3 


While the presence of zero modes for the Pauli operator in the plane seems to be rather 
common, for a long time no examples of zero modes were known in the three-dimensional 
case. Only in 1986, Loss and Yau [87] constructed a series of examples, where zero modes 
can occur. In particular, the operator with the magnetic field 


_ 12 
~ (1+ |x|2)-3 


B(x) (2x1.x3 2x2, 2x2x3 + 2x1, 1 — x? _ x + ia) 


possesses at least one zero mode. It was established recently by Erdés and Solovej that 
the dimension of the space of zero modes can be arbitrarily large [38], and Elton found 
that for any open set 2 C R? and for any m, there exists a potential A with support in Q 
possessing at least m zero modes [33]. For a decaying magnetic field one can estimate 
from above the number of zero modes. In fact, from the representation (2.6), it follows 
that this number can be majorized by the number of negative eigenvalues of the magnetic 
Schrédinger operator with electric potential —|B(x)|. Applying the magnetic CLR esti- 
mate, we obtain that the number of zero modes is not greater than c f |B(x)|?/? dx. The 
study of this number and also of the zero modes density n(x) = )~ lyrj(x) 7, where {yj} is 
the system of orthogonal zero modes, is an important problem related, again, to stability of 
different quantum systems and asymptotical behavior of spectral characteristics. Not much 
is known yet. It is found, however, that in dimension three zero modes are not a common 
feature. In particular, Balinsky and Evans showed that in L*/* (IR?) magnetic fields without 
zero modes form a dense open set and, moreover, for any magnetic field B € L*/, the set 
of t € (0, oo) such that the Pauli operator with magnetic field t6 has zero modes, is locally 
finite [10]. In the language of potentials, Elton established that in the space of continuous 
potentials A(x) decaying as o(|x|~'), potentials possessing at least m zero modes form 
a smooth submanifold of co-dimension m2, when m = 1,2 and is contained in a smooth 
submanifold of co-dimension 2m — 1 for bigger m [33]. With all this experimental evi- 
dence, the search is in the process for some quantization conditions which are expected 
to determine the presence of zero modes. This might have great importance for quantum 
theory. The reader is referred to [1,2] and references therein for further discussion on zero 
modes and their relation to physical problems. 
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11. Perturbed Pauli operators and Lieb-Thirring inequalities 


There are serious reasons to consider the Pauli operator in atomic physics when one takes 
into account the interaction of the magnetic moments of the electrons with the magnetic 
field via the Zeeman term o - B. This interaction becomes most essential when the magnetic 
fields in question are strong, for example, in astrophysics, and also quantum dots (e.g., 
artificial atoms). However the changes in the spectral properties of the operator are felt 
even for weak fields. 

As mentioned in Sections 8 and 9.5, the optimal form of CLR and Lieb-Thirring in- 
equalities for Schrédinger operators is well established, even in the case of very singular 
magnetic fields, and the remaining challenge consists in obtaining the optimal constants in 
these inequalities. 

When one replaces the Schrédinger operator by the Pauli operator, the situation changes 
completely. The main observation here is that generally, a perturbation by a negative elec- 
tric potential, even a very small one, may produce an infinite number of negative eigenval- 
ues (as it was first noticed in [9]), and it is the presence of zero modes which is the primary 
source for that. Hence, one cannot hope to find an analogy to the CLR estimate under gen- 
eral conditions. Thus in order to describe the distribution of these eigenvalues, one has to 
concentrate on the Lieb-Thirring-type inequalities, or look for some other characteristics 
of eigenvalues. 

The first result about Lieb-Thirring inequalities for the Pauli operator appeared only 
in 1994 [81] and concerned the constant magnetic field. Even here the situation turned out 
to be far from being simple. 


11.1. Constant magnetic field: The unperturbed operator 


We have described the spectrum of the Pauli operator in dimension d = 2 with constant 
magnetic field in Section 10.1. In order to perturb this operator and its three-dimensional 
counterpart by an electric potential, we need a more detailed information about the corre- 
sponding spectral subspaces, and it is more convenient to start by discussing the spectral 
properties of the magnetic Laplacian — A 4 with constant magnetic field in R* and R? (see, 
e.g., [29,138,149]). 

The potential A(x) has the form (Bx2/2, —Bx1/2,0), where the strength of the field B 
is supposed to be positive. In dimension d = 2 the spectrum of the operator -a® — 
—(V +iA)* (the superscript refers to the dimension) consists of eigenvalues with infinite 
multiplicity, 


Ag SOePe DB. P20; 1.2.3 (11.1) 


which are called Landau levels. This description of the spectrum follows from the one for 
the Pauli operator; see Section 10.1 and the formula (2.6) relating the operators we are 
studying now. The spectral projections Y, onto the corresponding spectral subspaces Ho 
are integral operators with smooth kernels ¥, (x’, y’) (we denote by x’ = (x1, x2) the two- 
dimensional variable in order to distinguish it from the three-dimensional one, x). All 
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kernels can be expressed explicitly via the Laguerre functions (see, especially, [150] where 
many other useful formulas related to this operator are given as well as its relation to the 
Heisenberg group). We will need here only the explicit expression for M(x’, y’), 


B 
4 


Yo(x',y') = = exp itsiys mys (x'-y’)’ ee ys). (11.2) 

Consider now the magnetic Laplacian -A? = -A® + Pa in three dimensions, where 
p3 = —i0/0x3. Define the subspaces H® = H ® L?(R!) (for readers not used to the 
tensor product, this simply means that these subspaces consist of L?-functions of three 
variables (x’, x3), that belong to He for almost all values of x3). Separation of variables 
shows that each subspace HY is invariant with respect to -a® and the spectrum of 
A? restricted to H?) is the semiaxis A, +R +; the latter are called Landau bands and 
the corresponding subspaces are band subspaces. The spectrum of the operator -AQ thus 
coincides with the union of Landau bands, i.e., the semiaxis [B, 00). The projections JT, 


onto subspaces H® have the form /7, = Y%, ® I (which means that they act as WY, in x’ 
and as identity operator in x3). One can formally (but rather conveniently) write [7p as an 
integral operator with kernel 


_B B , n2B 
TMo(x, y) = s— exp] i(xiy2 — x2) 5 (x’— y’) q [503 — ¥3)- (11.3) 


According to (2.6), the three-dimensional Pauli operator P_4 with a constant magnetic 
field B is the matrix operator acting on two-component vector functions and being the 
direct sum of operators P, = —A, + B and P_ = —A, — B. The spectral structure 
of P:, resp. P_, is obtained by shifting the spectrum of —A_, by B, resp. by —B. So, 
in particular, the spectrum of P, equals the semiaxis [2B, 00), and the one of P_ equals 
IR, = [0, oo). Each Landau band shifts accordingly but the band subspaces do not change. 
On the band subspace associated with the zero band, the Pauli operator P_4 acts simply 
as Pp}. which can be written as [IpP_4/71p = To p3 To. The same simplification can be made 
for the resolvents 


Ho(P.a+ 1)" 'Ho = To(p3 +4) To, “> 0. (11.4) 
It is the zero band (reaching zero), which is the cause of many interesting effects for the 
Pauli operator. 
11.2. Lieb-Thirring inequality for a constant magnetic field 
Now we perturb the three-dimensional Pauli operator by an electric potential V, viz. 
Pav=Pa— V(x). (11.5) 


We suppose that Vi € L3/20R3) Nn L9/2 (R3). 
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As we already mentioned, simple considerations based on the Glazman lemma (see 
Section A.9 and [9] for details) show that P4 y may have infinitely many eigenvalues 
even when V is a nice function with compact support (and it surely has if V is positive). 
However, the following Lieb—-Thirring inequality obtained by Lieb, Solovej and Yngvason 
shows that these infinitely many eigenvalues are summable [81]. 


THEOREM 11.1. Let Vy € L9/*(R3) 9 L3/2(R3) and let Ej(B,V) <0, j =1,2,3,..., 
denote the negative eigenvalues of the operator P_4 — V(x) in L?(R?, C*). Then 


\ |E(B.V)| <ciB | Vid + Cr f V4. (x)?! dx (11.6) 
F R3 R3 
J 


with C) =4/3m and Cy = 8V6/5n. 


More generally, for each 0 < 6 < 1, one can choose C; = (2/32)(1 — 6)~! and C) = 
(2./6/51)5~?. 


Inequality (11.6) does not match the classical phase-space expression which is given by 


B lee) 
\_|Ej(B, V)| = soy [| vee? +2 (¥e0) — 2009" a (11.7) 


i] v=1 


However, the two terms in (11.6) correspond, resp., to the B — oo (first term) and the 
B — 0 (second term) asymptotics of (11.7), that was rigorously established later (see 
[101,109,144]). 

The proof we present here is a somewhat simplified version of the one in [82]; we, 
however, do not struggle for the best constants C;, C2 in (11.6). 

In order not to interrupt the proof, we make some preparations. First, consider the oper- 
ator PS in L?(R!). The resolvent ( P3 +2)! of this operator can be found easily by means 
of the Fourier transform. It is an integral operator with kernel 


(p3 + u) ‘x3, y3) = (2)! i exp(ié3(x3 — y3)) (7 + u) | d&3. 


We are interested in the value of this kernel on the diagonal x3 = y3. A direct calculation 
gives 


(p} +4) | (3,43) = Qn)! [e+ pw) | dés = (4p), (11.8) 


In the three-dimensional case we will need the expression for the integral of the square of 
the resolvent kernel. Since 


(-—A+p)"'(x, y) = Qn) 3 i; exp(ié(x — y))(€? + u) | dé, 
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Plancherel’s equality yields 


2 


[I-a+w to nPay= en [(e +n) Pas 
(ny pe, (11.9) 


Next we give a simple inequality for functions. Let x, (A) be the characteristic function 
of the semiaxis 4 > / and let jz be some positive number. Then 


Atp) ya) <2a+l+y) 1, ~>0. (11.10) 


The inequality follows immediately since A > (A. + 1)/2 for 7 > 1. 
Finally, we establish a useful inequality for the distribution function. (For trace class 
operators, see Section A.8.) 


LEMMA 11.2. If S and T are positive semidefinite trace class operators, then the number 
N of eigenvalues greater than or equal to | of S+T satisfies 


N <2trS+4trT?. (11.11) 


PROOF. Let (0; ee , be the orthonormal eigenfunctions for S + T with eigenvalues greater 
than or equal to 1. For each j we have either 


1 
or (6;,1T1¢;) > 5 (11.12) 


1 
(pj, |Slb;) > . 


Since ($j, |T16;)? < (bj, 6j)(¢;, |T716;) = (6; |T71@;), we infer that 2trS + 4trT? > 
YL 2G), IT 16;) + 4(G;, IT716;) > N 


Now we can proceed with the proof of Theorem 11.1. 
PROOF OF THEOREM 11.1. First of all, we note that the operator P_, y is a direct sum 
of P, — V and P_ — V. Since P, — V > P_ — JV, it suffices to prove our estimate for 


P_—V only. 
For E > 0 we define the Birman—Schwinger operator 


1/2 E\" in 
ke=v_h(P- +5) Ve (11.13) 


where Ve = (V — (E/2))+. We divide Kg into a part coming from the lowest Landau 
band and a part coming from the higher bands. For this purpose we define 


1/2 E 1/2 
Ki =v,"n m( P+ >) ‘Tov! 


E —1 
=v, TM m( 13+ 5) ToVn, (11.14) 
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where, in the last equality, we used (11.4). Moreover, we define 


1/2 


= 1/2 EY 
Kp=V,; U—Ho){P-+>) (—Ho)Ve (11.15) 


Clearly, Kp = K : +K B since P_ commutes with J/o. 

To calculate the trace of K Bs we first cyclically rearrange factors in Ke (this does not 
change trace; cf. Section A.8) and then use the explicit formulas (11.3) and (11.8) to inte- 
grate the kernel over the diagonal x = y 


E\-! 
tr(K?,) = ul Verto( 13 + 5) 
E\-! 
a al Ve (x)(Wo(x’, x’) (03+ 5) (x3, x3) dx’ dx3 


B —1/2 
= 5, 28) [vecoax. (11.16) 


The second part of the Birman—Schwinger operator will be evaluated in the following 
way. Denote by @Q the spectral projection of P_ corresponding to [B, 00). We have 


(1 — Ho) Q = (1 — Ip). (11.17) 


According to the spectral theorem (see Section A.5), the operator Q(P_ + fy! Q equals 
g(P_), where g(4) =(Q+ S)-1x, (A). Using (11.10) and the functional calculus (Theo- 
rem A.2 in Section A.5), we obtain the operator inequality 


E\~! E\~! E\~! 
o(r.+) 0<2(p.+8+5) =2(-a4+5) (11.18) 


According to (11.17), this implies that 
=| =I 
E E 
UM) P+ 5 | (= 1h) <2(-a4+ 5) . (11.19) 
This operator inequality keeps being true after we multiply it from both sides by Vz, 
-1 


a E 
Vid = m)| P- z3 5 (I — To) Vr <2Ve(-Aa+ 3) Ve. (11.20) 


The above inequalities are operator ones, understood in the Hilbert space sense. Now we 
pass to integral kernels and use the diamagnetic inequality for resolvents, 


(Aut) lx, y)| <(-At+ pm)! -y). 
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Thus we get the following estimate for the trace of (K Pe 
; E\7! 2 
u[(Kz)"] < sul Ve (-a.4 + 5) ve] 
2 


=, 
<4f | vew|[-a+ 5] «-» Ve(y)dx dy. 
R3 R3 2 


We apply Schwarz’ inequality to the latter integral, which gives us the estimate 


E17! 2 
uf(xzy]<a fv max f Ski dy. 
(KE) ]<4 f VeG)dx f y[-A+ 5] Op dy 

The value of the latter integral we know, see (11.9), so we obtain 
uf(xz)']<c f Ve (x)? dx. 
R3 


To complete the proof of Theorem 11.1, we use that, as a consequence of the Birman— 
Schwinger principle, 


\ |Ej(B. V)| <[ nede < [° (ou(Kd) +40[(xz)}}ae. (11.21) 
j : : 


We insert here the estimates for trK ° and tr[(K ey | we have just derived, and after per- 
forming integration we arrive at (11.6). 


A similar result, with a somewhat simpler proof, is valid in the two-dimensional 
case [83]. 


THEOREM 11.3. Let Vy € L'(R*) N L?(R?). Then the negative eigenvalues Ej of the 
Pauli operator P_4 — V with a constant magnetic field B satisfy the inequality 


B 
Diel<= f Ve(ayds +3 | Vi(x)? dx. (11.22) 
TU R2 R2 


In [81-83] spectacular applications of these inequalities to the problem of stability of 
matter and analysis of ground states of large quantum systems are given. 


11.3. Distribution of eigenvalues 
Another way to describe the spectrum of the Pauli operator with a constant magnetic field 


is to study the distribution of eigenvalues near the Landau levels in dimension 2. If the 
electric potential V decays at infinity then it is a relatively compact perturbation of Pg and, 
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according to Weyl’s theorem, the essential spectrum of the perturbed operator Pg + V is 
the same as of Pg. This means that some, finite or infinite, eigenvalue clusters may form 
around each Landau level; if the cluster is finite, the Landau level remains intact, if the 
cluster is infinite, the eigenvalues there must converge to the Landau level, the latter may 
disappear. To find out what really happens, we introduce the distribution functions. Let 
A be a Landau level, we fix some s < A, so that the interval (s, A) does not contain other 
Landau levels, and for A € (s, A) denote by n(s, A; V) the number of eigenvalues of the 
operator P + V in (s, A). The problem consists in studying the behavior of this quantity 
as 24 — A: if it is bounded then the number of eigenvalues which split down from A is 
finite; if n(s, 4; V) is unbounded, one has to find estimates and, if possible, asymptotics as 
2. — A—O. Ina similar way, fixing some s above A one considers the behavior of n(A, 5) 
as 4 > A+0,i.e., distribution of eigenvalues splitting up from A. In the three-dimensional 
case, similar problems can be stated only for the distribution of eigenvalues lying below the 
lowest Landau level, since the whole positive semiaxis is covered by the essential spectrum. 
These problems were studied in [108,139-141,146,147]. It was found there that in three 
dimensions, and in the case of not too fast decaying V, in two dimensions, there is an 
infinite set of eigenvalues splitting from each Landau level, up or down, if the electric 
potential has, respectively, nonzero positive or negative part, and additionally asymptotic 
formulas were proved, admitting explanation in terms of the phase-space volume. Only 
recently, Raikov and Warzel [111] and Melgaard and Rozenblum [100], considered the case 
of very fast decaying potentials V (including compactly supported ones), and a number of 
pathologies were discovered. In particular, if V has constant sign, an infinite number of 
eigenvalues split from each Landau level, however they converge there so fast that the 
asymptotic behavior of n(s, A; V) or n(A, s) does not fit into the phase volume pattern and 
even does not depend on V. For the case of variable magnetic field, when zero is an isolated 
eigenvalue of the unperturbed Pauli operator with infinite multiplicity, similar results on the 
distribution of eigenvalues of P + V near zero were obtained by Raykov [110]. 


11.4. Arbitrary magnetic field 


Erdos initiated the study of Lieb—Thirring inequalities for Pauli operators with nonho- 
mogeneous fields [34]. He observed that the direct extension of (11.6) to the case of the 
nonconstant fields, namely 


DIEiB. V)| 


J 


KCiy / |B(x)| V4.0)? dx + C2, ih Viger dy: (11.23) 
R3 R3 
as well as its possible consequence (via Hélder’s inequality) 


> EIB, V)| 


J 


Sia [\eoP? vcr" dx +p, [ Vi (x)? #3/? dx, (11.24) 
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is false without substantial regularity conditions on B. In addition, he conjectured in [34] 
that it would be necessary to replace |B| by some effective field strength, Berr(x), obtained 
by averaging |B] locally on the magnetic lengthscale, |B|~!/?. 

Finding proper Lieb-Thirring-type inequalities for the Pauli operator is crucial for the 
problem of stability of relativistic matter: in proving that the relativistic Hamiltonian for a 
large Coulomb system of particles in a magnetic field is semibounded from below as well as 
to find reasonable dependence of the lower bound on the number of particles and the energy 
of the field. One more source of inspiration for construction Lieb-Thirring inequalities lies 
in establishing asymptotic formulas, with respect to all parameters involved, for regular and 
some singular potentials [36,144]. Since the “natural” inequality is wrong and there is no 
intrinsic candidate for the “effective” field, the search in recent years went in the direction 
of finding estimates satisfying some natural scaling conditions, and then checking how 
good they serve the main problem. The scaling properties involve behavior for large and 
small fields as well as with respect to Planck’s constant i. We describe some key results 
here. 

Motivated by Erdos’ observation, Sobolev [142,143] obtained estimates in the forms of 
(11.23) and (11.24), but with |B| replaced by a effective (scalar) magnetic field Ber(x), 


y-|E;(B, V)| <cif Be x)*?>V;. (xx + Co f Vix)? dx. (11.25) 
ane R3 R3 
J 


Roughly speaking, Begf(x) is a slow varying function which dominates |B(x)| pointwise. 
Subsequently, Bugliaro et al. [21] and Shen [125,126] established (11.25) with a Begf(x) 
whose energy is comparable to that of |5|, viz. || Betr|| 2 ~ ||| ,2 (Shen showed that the 
same holds for any L? norm). The latter in particular implies the following estimate by 
Lieb, Loss and Solovej [80]. 


THEOREM 11.4. Let V1 € L°/2(R3) 9 L4(R3) and let Ej(B,V) <0, j = 1,2,3,..., 
denote the negative eigenvalues of the operator P_ 4 — V(x) in L?(R?, C*). Then 


DIE; B.V)| 


J 
3/4 1/4 
<ay { Vi. (x)>/? dx + by (/ BU) ax) (/ vs(a)*ar ) (11.26) 
R3 R3 R3 


for all 0 <0 < y, where ay = (27/7/5)(1 — y)“!L3 and by = 3'/42~/4ny 3/8 — 
wy 7/8 La, One can take L3, defined above, to be 0.1156. 


The estimate (11.26) and the estimate by Bugliaro et al. [21] (and Shen [125,126]) have 
been very useful in the proof of stability of matter within the Pauli setting; in this case the 
magnetic energy, [ |B’, is also part of the total energy to be minimized and thus even the 
second moment of the magnetic field is controlled [80]. 

Another reason why (11.23) cannot hold for an arbitrary magnetic field is due to the 
existence of the zero modes [87], see Section 10. Indeed, for certain magnetic fields with 
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nonconstant direction the Dirac operator D := o - (—iV + A) has a nontrivial L?-kernel. 
If n(x) denotes the density of zero modes, n(x) = )* ; Iw j(x) ee where {y;} is an orthonor- 
mal basis in KerD, then under a small potential perturbation of D* the sum SA jlEiPAV)I 
behaves as Mf n(x) V4(x) dx, Le., itis linear in Vi. Hence an extra term linear in Vi. must be 
added to (11.23) and n(x) has to be estimated; being an important characteristic by itself. 
In the works [21,34,80,125,126,142,143] the density n(x) is estimated by a function that 
behaves quantitatively as |B(x)|*/*. In particular, in the strong field regime these estimates 
are not sufficient to prove semiclassical asymptotics for P4 y(h, b) uniformly in b; they 
give the asymptotics only up to b < const -h7! [144]. 

The key task is thus to understand the density of Loss—Yau zero modes. Since n(x) scales 
like (length) ~> and |6(x)| scales like (length) ~* under the dilation of the space, a simple 
dimension counting shows that n(x), therefore oar |E;|, cannot be estimated in general 
by |B(x)| or by its smoothed version. However, if an extra lengthscale is introduced, for 
example, certain derivatives of the field are allowed in the estimate, then it is possible to 
give a bound on the eigenvalue sum that grows slower than |B|*/? in the large field regime. 

The semiclassical formula for the sum of the negative eigenvalues, a IE,(Payv)I, 
for a constant magnetic field behaves linearly in the field strength, |B], see (11.7). This 
fact suggests that }~ ; |Ej(P,v)| may be bounded by an expression that grows with the 
first power of |6| even for nonconstant magnetic fields and away from the semiclassical 
asymptotic regime. 

Two physical applications, especially, motivate the search for Lieb-Thirring inequalities 
which are optimal in the strong B-field regime with respect to the field strength |B|, namely 
strong magnetic fields in astrophysics, and quantum dots (in particular, artificial atoms). 

Recently, Erdés and Solovej [39,40] obtained two qualitatively different Lieb—Thirring 
inequalities which fulfill these conditions with as weak assumptions on B as possible and 
no technical assumptions on V. The methods behind the proofs of these two estimates are 
very different and they are somewhat complementary. 

While both Lieb-Thirring inequalities are sharp as far as the potential and the strength 
of the magnetic field are concerned, they require additional technical assumptions on the 
magnetic field. These are usually formulated in terms of variation lengthscales, and practi- 
cally they are regularity assumptions on 8. This means that supremum norms of derivatives 
of the magnetic field appear in the final Lieb—Thirring inequality. 

The difference between the two inequalities is that the more involved bound, see Theo- 
rem 11.7, contains only local supremum norms. Therefore it enjoys an important locality 
property: the estimate is insensitive to the behavior of the magnetic field far away from the 
support of V,. The simpler inequality, Theorem 11.5, involves the global C>-norm of the 
direction of the magnetic field, n := B/|6|. In particular, irregular behavior of n far away 
from the support of V, renders our estimate large despite that it should not substantially 
influence the negative spectrum. As a compensation, less assumptions on the regularity of 
the field strength |B| are required and the proof is much shorter. 


The simpler inequality. Consider the three-dimensional Pauli operator, P.4,y = D* — V, 
with a differentiable magnetic field 6b = V x A, D:=o - (—iV + A) being the Dirac 
operator. We make two global assumptions: 
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ASSUMPTION 1. B(x) 4 0 for all x € R®, ie., the unit vector field n:= B/|B| is well 
defined. 


ASSUMPTION 2. The vector field n satisfies the following global regularity condition 
5 
Ea) := >| V%al| 2” <00, (11.27) 
y=l 


where Ly is called the global variation lengthscale of n. 
For any L>0,x€ R°, we also define 
By (x) := sup{|B(y)|: ly — x] < L} + L- sup{|VBQ)|: ly — x1 < L}. 
The simpler inequality takes the following form [40]. 
THEOREM 11.5 (Lieb-Thirring inequality without a locality property). For any 


0<L< Ly, the sum of the absolute values of the negative eigenvalues, E; < Er <--- <0, 
for Py satisfies 


YS |Ei(Pav)| < o(e7' f (Bio) + 1)v-00 41 
j 


+f BieoveeyPars f vs(a)°?dr) (11.28) 
R R3 


with a universal constant c. 


The involved inequality. Next we give the basic set-up necessary to present the more 
involved Lieb-Thirring inequality. 

We assume that B € C*(R?, R3), and define three basic lengthscales of B. The Pauli 
operator will be localized on these lengthscales. Let n := B/|B| be the unit vector field in 
the direction of the magnetic field at all points where B does not vanish. For any L > 0 and 
x € R3, we define 


By (x) = sup{|BQ)|: lx — yl < L} (11.29) 
and 
bi (x) := inf{|B(y)|: |x — yl < L} (11.30) 


to be the supremum and the infimum of the magnetic field strength on the ball of radius L 
about x. 
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DEFINITION 11.6 (Lengthscales of a magnetic field). The magnetic lengthscale of B is 
defined as 


Lin (x) = sup{L >0: Bh(x)< ae 
The variation lengthscale of B at x is given by 


Ly(x) = min{ Ls(x), EnGo)} 


where 
Ls (x) := sup{ L > 0: 
LY sup{|V’ |B(y)||: |x — yl < L} <bL@), y = 1,2,3,4}, 
Ly(x) = sup{ L > 0: 
LY sup{|V’n(y)|: |x — yl < L, BG) £0} < 1, y = 1,2,3, 4} 
(with the convention that sup § = —oo). Finally we set 


Bola sSmax( DAG); Lat}. (11.31) 


A magnetic field B: R* —> R? determines three local lengthscales. The magnetic length- 
scale, Lm, is comparable with |b [ 2 The lengthscale L, determines the scale on which 
the strength of the field varies, i.e., it is the variation scale of log |B|. The field line struc- 
ture, determined by n, varies on the scale of L,,. The variation lengthscale Ly is the smaller 
of these last two scales, i.e., it is the scale of variation of the vector field B. 

For weak magnetic fields the magnetic effects can be neglected in the final eigenvalue 
estimate, so the variational lengthscale becomes irrelevant. This idea is reflected in the 
definition of L,; there is no need to localize on scales shorter than the magnetic scale Ly. 

With these preparations we are ready to formulate the main result in [39]. 


THEOREM 11.7 (Lieb-Thirring inequality with a locality property). Assume that the mag- 
netic field B= V x A is in C*(R?,R3). Then the sum of the negative eigenvalues of 
Pav=lo-(P+ A)/’ — V satisfies 


Dieil<e f vecydx+e f |B(x)|V4.@x)7/? dx 
; > R3 R3 


+ef (|BQx)| + Le(x)~*) Le (x)! V4. (x) dx. (11.32) 
R3 


For the proof we refer to the paper [39]. More estimates having different forms were 
obtained in recent years [22,37]. In general, however, there is still no conjecture for the 
form of Lieb-Thirring inequalities for arbitrary magnetic fields, optimal in all aspects. 
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Lately much effort has been put into the search for bounds on >> j/Ei(Pa,v)| which 
grows like |B| even for nonconstant fields and away from the semiclassical asymptot- 
ical regime. Such bounds would allow one to prove the semiclassic asymptotics for 
par |E;(P.4,y)| uniformly in Bas h J 0. 
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Appendix. Basic facts from abstract spectral theory 
A.1. Linear operators. Closed operators 


Let 7{ be a complex Hilbert space, let D C H be a linear subset, usually dense, and let 
T:D— H be a linear (not necessarily continuous) map. For brevity, T is said to be a 
linear operator in H. The set D is denoted O(T) and called the domain of the operator. If 
Do is a linear subset of D then Ty = T|p, is said to be a restriction of T. The operator T 
is then called an extension of T. We shall write Ty C T. 

On D(T) one can define the graph norm or T norm || - ||7 by 


lulz = (Tull? + llul?, we D(T). (A.1) 


T is said to be a closed operator if D(T) is complete in the T norm. An equivalent defini- 
tion is this: T is closed of its graph G(T) = {{u, v} EH @H: u € D(T), v = Tu} is closed 
in H @ H. We say that T is a closable operator if the closure of the graph of T in H @H 
is also the graph of an operator. An equivalent condition is that if {u,}, where u, € D(T), 
is a Cauchy sequence in the T norm and ||u,,|| > 0 then ||u,||7 — 0. The latter property 
means that the topologies generated by the norm of 71 and by the T norm on D(T) are 
compatible. 

If T is closable then the operator T defined by G (T) = G(T) is called the closure of T. 
If T is bounded then T coincides with the extension of T by continuity. 

An operator T from 7; into 7/2 is said to be bounded if there exists a C > 0 such that 
|Tulla, < Cllulla, for all uw ¢ D(T). Any such C is called a bound of T. 

An operator T from 7{; into 712 is said to be compact if every bounded sequence {uy} 
from D(T) contains a subsequence {uy, ‘i for which {Tun ;} is convergent. 

By B(H1, H2) and Boo(H1, H2) we denote respectively the spaces of everywhere 
defined bounded and compact operators acting from H, into H2; B(H) := B(H, HW), 
Boo(H) := Boo(H, H). The norm of an operator T in any of these spaces is given by 


7] =inf{C > 0] ||Tullo, < Cllullyy, for all u € D(T)}. 
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A.2. The adjoint operator 


Let T be a densely defined operator, i.e., 0(T) = H. Then the adjoint operator T* can be 
constructed as follows. The domain of T* is 


D(T*) = {v eH | dh eH: (Tu, v) = (u,h) Vue D(T)}. (A.2) 
The vector / is uniquely determined by v, and we set h = T*v. Thus 

(Tu,v) =(u,T*v) Vue D(T), Vv €D(T*). (A.3) 
As opposed to the case of T € B(H), this equality is used not only to describe the “action” 
of T* but, as we shall see, also to describe the domain of T*. 


The operator T* is always a closed operator, and D(T*) = H if and only if T is closable. 
If the latter holds then (T*)* = T. If To C T and D(To) = H then yee ot le 


A.3. Self-adjoint operators 


An operator T which fulfills T* = T is said to be self-adjoint. 
An operator 7, such that D(7) = H and 


(Tu,v) =(u,Tv) Vu,veD(T), (A.4) 


is called symmetric. These two notions are equivalent for T € B(H). If T* = T then T is 
said to be essentially self-adjoint. If T is symmetric and T 4 T* then T* is seen not to be 
symmetric. 

The self-adjointness of an operator can often be established by means of perturbation 
theory, i.e., from the fact that the operator is close to another operator known in advance to 
be self-adjoint. 


A.4. Spectrum of an operator 


Let T be a closed operator. By definition, the resolvent set p(T) consists of points A € C 
such that there exists (T — AJ)~! € B(H) (J being the identity operator in 1). The com- 
plement o (T) = C\p(T) of the resolvent set is called the spectrum of T. The set p(T) is 
open and o(T) is closed. It is possible that o (T) = C or o (T) = @. (For T € B(H) neither 
of these possibilities can be realized.) 

If T = T* then the spectrum of T is nonempty and lies on the real axis. The spec- 
trum o (T) of a self-adjoint operator can be represented as the union of the point spectrum 
0p(T), i.e., the set of all eigenvalues, and the continuous spectrum 


o(T) = {A E R| Im(T — iJ) is a nonclosed set}. (A.5) 
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The spectra op(T) and o,(T) can have a nonempty intersection. If op(T) = @ then T has 
a purely continuous spectrum. If the linear hull of the eigenspaces Ker(T — AJ), where 
4 € op(T), is dense in H then T has a purely point spectrum. In this case the continu- 
ous spectrum coincides with the set of limit points of the point spectrum and, generally 
speaking, is nonempty. 

The union of the continuous spectrum and the set of eigenvalues of infinite multiplicity is 
called the essential spectrum of a self-adjoint operator T , denoted oes5(T). If oess(T) = O 
then T has discrete spectrum. An equivalent condition for T to have discrete spectrum is 
that (T —AI)~! bea compact operator for some A € o(T) (and then for all such A). 


A.5. The spectral theorem 


Suppose that associated with every Borel set $2 C R is an orthogonal projection E({2) 
in H. Let E(R) = / and let the following condition of countable additivity be fulfilled: 
if {Q,},n=1,2,..., are pairwise disjoint Borel sets, then }°,, E(Q,) = E(U,, 2n). (The 
series on the left-hand side converges in the strong operator topology.) Any such map 
E:92t E(&2) is called a spectral measure in H (defined on the Borel subsets of the real 
axis). 

If E is a spectral measure then, for any u € 7, E(-)u is a vector-valued measure and 
Ly (-) = (E(-)u, u) is a scalar-valued Boreal measure normalized by j1,(-) = ||u||*. 

For any u,v € H, by.y(-) = (E(-)u, v) is a complex-valued Borel measure. 

As in the case of scalar measures, the support of a spectral measure (supp E) can be 
defined as the smallest closed subset F C R such that E(F) = J. The phrase “almost 
everywhere with respect to E” (E-a.e.) has the standard meaning. 

Let E be a spectral measure and let f be a Borel measurable scalar function defined 
E-a.e. on R. Then one can define the integral 


Jp = i fdE (- / f(s)aE()). (A.6) 


which is a closed operator in 7 with dense domain 


DI) =Dy=|uen| fisPeus <0}, (A.7) 


The integral (A.6) can be understood, for example, in the “weak sense”, that is, (Ju, v) = 
J fu,» for u € Dy and v € H. The operator Jy is self-adjoint if and only if f is an 
E-a.e. real-valued function. J+ is bounded if and only if f is E-a.e. bounded. 

The following spectral theorem plays a central role in the spectral analysis of self-adjoint 
operators. 


THEOREM A.1. To every self-adjoint operator T there corresponds a unique spectral 
measure Ev such that 


T = [ sazrey. 
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One has that suppEr =o (T). 


Having a spectral measure, we can associate to any bounded Borel function f on o(T) 
the operator Jy. This mapping f +> J; = g(f) gives the following functional calculus 
form of the spectral theorem which is very useful. 


THEOREM A.2. Let T be a self-adjoint operator on H. Then there exists a unique map 
from the bounded Borel functions on o (T) into B(H) having the following properties: 
(i) @ is an algebraic *-homeomorphism, i.e., 


o( fg) = o(f)e(g), pAf) =r9(f), 
gA)=1, o(f)=o(f)*. 


(ii) g is norm continuous, i.e., ||e(/lBay < || fllt~- 

(iii) Let { fy} be a sequence of bounded Borel functions obeying fn(x) — x for each x 
(asn — oo) and | fy(x)| < |x| forall x and n. Then, for any © € D(T), limn+o (fn) Vv = 
Ty. 

(iv) If fu(x) > f(x) pointwise and if the sequence {|| fn\|L~} is bounded, then 
(fn) > G(f) strongly. 

(v) If Ty = dy, then (fw = fr. 

(vi) If f 20, then p(f) > 0. 


A.6. Various spectra 


Let T be a self-adjoint operator in 7{ and let Ev be the spectral measure of T. One can 
distinguish the following subspaces: 7{p defined as the closure of the linear hull of all 
eigenspaces of T, Hac defined as the set of all uw € 7 such that the measure ft: ()= 
(E7(-)u,u) is absolute continuous with respect to the Lebesgue measure, and 71{sc, the 
orthogonal complement of Hp ® Hac in H. If u € Hse then ie is a continuous measure 
singular relative to the Lebesgue measure. 

The subspaces Hp, Hac and Hc are orthogonal to each other and invariant with respect 
to T. The parts Tp, Tac and Ts, of T in these subspaces (for example, Tae = T|D(7)nH,.) are 
self-adjoint as operators in Hp, Flac and Hc, respectively. They are called the pure point, 
absolute continuous, and singular continuous components of T. One can also speak about 
the absolute continuous components of the spectrum, etc. If T = Ta, then the spectrum 
of T is said to be absolute continuous. 


A.7. Distribution function 
The distribution function 


N(I; T) = dimRan Er (1) (A.8) 
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(J C R being an arbitrary interval) serves as an important characteristic of the location 
of the spectrum of a self-adjoint operator T. The case when N(J; T) < oo is the most 
interesting one. In this case, the spectrum of T on / consists of finitely many eigenvalues 
of finite multiplicity and (A.8) is equal to the sum of the multiplicities. If NU; T) = co 
and J is a bounded interval, then the closure of J contains at least one point belonging 
to Oess(T). If 1M oess(T) = @ then the spectrum of T is said to be discrete on I. 

For a lower semibounded self-adjoint operator, we set 


N(A; T) = N((—00,4);T) VWAeR. (A.9) 


A.8. Classes of compact operators 


The following information on compact operators can be found in, e.g., [17], Chapter 11. 

If T is acompact operator on some Hilbert space H and 4; = wj(T), j € N, denote the 
eigenvalues of T enumerated counting algebraic multiplicity in the order of nonincreasing 
moduli |/;|, then the nonzero eigenvalues s; = s;(T) = /uj(T*T) of |T| are called the 
singular numbers or singular values or s-numbers of T. If ar s;(T) < 00, then T is called 
a trace class operator. For trace class operators, the series 


P=" iT) 
j 


is absolutely convergent. The set of all trace class operators is denoted by G6! and it is an 
*-ideal in B(H), viz. 

1. G! is a vector space. 

2. If T; € G! and T> € B(H), then T;T € G! and TMT, € G!. 

3. If T, ¢ G!, then T/ € G!. 
If T € G! and {gp} is any orthonormal basis, then tr T equals the sum yon (Gn» Tn) which 
also converges absolutely and the limit is independent of the choice of the basis. The map 
tr: 6! — C, defined either way, obeys: 

1. tr(-) is a linear map. 

2. wT* =trT. 

3. tT, Io =tr hT, if Ty € G! and To € BCH). 
Let n(s, T) =#{s;(T) > 5}, s > 0, be the counting function. By the definition of s;, one 
has that 


n(s*, T*T) =n(s,T), (A.10) 


and for any self-adjoint nonnegative operator, one has s;(7) = ;(T). The counting func- 
tion satisfies the Weyl inequality, 


n(sy +82, Tj + Tr) <n(s1, T1) + n(s2, Tp). (A.11) 
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For 0 < p < o the trace class (or Neumann-Schatten class) G? is a set of T € 
Boo(H1, H2) for which the following functional is finite 


(oe) 
IT Seau.an = Li) = p / s?In(s, T)ds. (A.12) 
: 0 
J 


If p > 1 then (A.12) defines a norm on G? and a quasinorm for p < 1. Evidently, T € 
61 (H,, H2) if and only if 
tr(|7|4) = ie((T Te) <0O. 


For 0 < p < oo the class 64, (H1, H2) C Boo(H1, H2) is the set of all compact operators T 
such that the following functional is finite: 


1/p 
IT lee i= (sups?nis, T)) 
me s>0 


The functional || - || g? is a quasinorm. The classes 62,(H1, Hz) are not separable (if 
dim 71; = dim H2 = 00); a separable subspace Ge c 6%, is defined by 


6b := {7 es? | lim s?n, r)=0}. 


Note that G? C GF 
For a compact self-adjoint operator T we set 


na(s,T) = N((A, 00); +7). (A.13) 


For operators T = T* € By the following functionals are introduced: 


A“ (T) := limsup s?nx(s, T), (A.14) 
S—>0o 
7) := liminf s?na(s, T), (A.15) 
S—>0o 


so that 0 < 8 (T) < ART < co. The functionals AS, a are continuous in $,, and 
do not change if their argument changes by an operator of the class or . 


A.9. Glazman’s lemma 


The spectral theorem leads to the variational principle for the distribution function. There 
are many different formulations of this principle, the one most convenient for our pur- 
poses is called the Glazman lemma, which plays an important role in both qualitative and 
quantitative spectral analysis. 
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For an operator with quadratic form t[u], the number of points of the spectrum, finite or 
infinite on some interval, is described by the dimensions of subspaces in D(t) where the 
ratio t{u]/||u||z7 = x[u] is controlled. In particular, N(A; T), for the operator T defined by 
the quadratic form t, equals the maximum of the dimensions of subspaces where x[u] < A, 
or minimum of the co-dimensions of subspaces where x [u] > A. Construction of subspaces 
satisfying these inequalities immediately gives estimates for N(A; T) from below, resp. 
from above. Taken together, they, in particular, prove various versions of the Birman— 
Schwinger principle; see Section 6.2. 


LEMMA A.3. Let T be a lower (upper) semibounded self-adjoint operator and M Cc D() 
be a linear subset, dense in the T -norm. Then 


Na(a, T) =maxdim{£L cM: +(t[u] — Allull*) <0,w € L \ {0}}, (A.16) 


Nu (A, T) =mincodim{L CD(t): +(t[u] — Allul|?) > 0, € LI. (A.17) 


Here codimL for a subspace LC D(t) denotes the minimal number of orthogonality 
conditions which determine £L. Minus and plus signs correspond to upper, resp. lower, 
semibounded operators. 


An important consequence of the Glazman lemma is that the distribution function de- 
pends on the quadratic form in a monotone way. Let, for example, two operators T; and 7 
correspond to quadratic forms t;[u], to[u], so that O(t;) C O(t) and t[u] > tov], 
u € D(t,). Then in (A.16), the set of subspaces over which we maximize is larger for Ty 
than for 7), and therefore, N(A, T2) > N(A, T;) for any 2. 

We collect some properties of the distribution function for the Schrédinger operator 
Hy =—A— V. The following lemma follows immediately from the Glazman lemma. 


LEMMA A.4. (i) If Vi < V2 pointwise, then N(—E; Hy,) < N(—E; Ay,) for all E > 0. 
In particular, N(—E; Hy) < N(-E; Hy,). 
(ii) For alla € [0,1] and E >0, 
N(-E; Hy) < N(-a@E; Ayy(x)-—-a)E),.); (A.18) 


where (V(x) — (1 — a) E)4 denotes the positive part of the potential V(x) —(1—a)E. 


Looking at the graph of N(—E; Hy) one sees that integrating N(—E; Hy) with respect 
to E yields (minus) the sum of the negative eigenvalues. More generally, since 


0 
aENCE Hy) =- dE — Ej), 
J 


where {£;}; denote the eigenvalues of Hy, one has the following result [84,85]. 
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LEMMA A.5. Let y > 0 and Syq(V) ‘= DE; <0 lEj|”. Then 


[o@) 
s.av)=y [ E’—!N(—E; Hy)dE. (A.19) 
0 


A.10. Birman—Schwinger principle 


A variant of the method of forms based on the notion of a variational triple is useful in a 
number of cases, in particular in the study of spectral problems of the form 


Gw =AHow. (A.20) 


A variational triple {H; ho, g} consists of a Hilbert space 7 with a metric form ho[u] 
and a bounded sesquilinear Hermitian form g[u, v] in 71. The relation 


glu,v]=bo[Tu,v] VWu,veH 


assigns a unique operator T = T(‘H; ho, g) to {H; ho, g}. The operator T is bounded and 
self-adjoint in 7. 

In particular, let ho and g be the quadratic forms of operators Hg and G acting in a 
Hilbert space 1. More precisely, let Hp be a positive definite self-adjoint operator and 
let ho be its associated quadratic form. We assume that G is a symmetric operator de- 
fined on a dense set D C (hg) (in the simplest case D = D(Ho)) and the quadratic form 
(Gu, v) is bounded in (ho). Extending the form by continuity, we can obtain a bounded 
form g[u] on Q(ho). Hence we have constructed a variational triple {H; ho, g}. The oper- 
ator determined by the triple coincides with Hy 1G. Q(ho) > Q(ho) on D. It is therefore 
natural to associate the spectrum of this operator with (A.20). 

The study of the negative spectrum of the Schrédinger operator with a decreasing poten- 
tial can be reduced to the investigation of the spectrum of an equation of the form 


pw=(-Awt+ew), €>0. 


The abstract scheme of such a reduction was developed by Birman [14]. We shall state 
only the simplest result from [14]. 


THEOREM A.6 (Birman—Schwinger principle). Let H and Ho be semibounded self- 
adjoint operators in a Hilbert space H and let Ho > 0. Let h and ho be the corresponding 
quadratic forms, and let Q(h) = Q(ho) = K. Let T;, where ¢ > 0, be the operator deter- 
mined by the variational triple {K; ho[u] + Ellul, g = ho — 5}. Then 

N(—e; H) =n, Te). (A.21) 


If Ho is positive definite, then (A.21) is also valid for ¢ =0. 
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The operator 7; is traditionally called the Birman—Schwinger operator. The proof of 
Theorem A.6 can be reduced to comparing the formulae 


N(-e, H) =maxdim{L CK: b[u] + eljull* <0}, 
ny(1, Te) =maxdim{£ CK: glu] > bolw] + ellull”}, 


which follow directly from Lemma A.3. The assertion concerning the case ¢ = 0 can be 
extended to any Ho > 0, but the formulation becomes more involved (see [14]). 


A.11. Asymptotic perturbation lemma 
Generally, one should expect that if one perturbs an operator with a weaker one, the main 
properties must not change. The lemma we give here (established first in [16]) assigns 


concrete meaning to this vague statement, as it concerns asymptotics of the spectrum. 


LEMMA A.7. Let K be a compact self-adjoint operator, and for some q > 0 and any 
é >0, K may be represented a sum, K = K, + Ki, where 


lim na(t, Ke)t? =cx(e), lim supns(t, K;)t? <e. 
t>+0 t>+0 


Then there exist limits limg_.9 cx. (€) = c+ and lim;+49nai(t, K)t? =cx. 


PROOF. Fix some 6 > 0. The Weyl inequality (A.11) gives n4(t, K) <n4(t(1 —54), Ke) + 
n+(t6, K;). Passing to lim sup, we obtain 


er =limsupni(t, K)t? <ci(e)(1 —8)4 +6 4e. 
t>0 


On the other hand, applying Weyl inequality to K, = K + (—K{), we obtain n,(t, K) > 
n4(t(1+54), Ke) —n_(t6, K;). Passing here to liminf, we get for ee = liminf;.9 N+(t, 
K)t~4 

ae lim n4,(¢(1 +8), Ke)¢4 — lim sup n_ (08, Ki) 14 

i t>0 
>cz(e)1+8) 7-5 Ze. 

Thus 

cy(e)1 +8)-9 — 8-4 <eOD Sc Sey (OL — 54 +474. (A.22) 


We set here 5 = ¢!/@+) go that 5~Ve — 0. Then (A.22) gives en? = a” = limc+(e). 
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The lemma plays a crucial role whenever one wants to establish an asymptotic formula. 
Here the general scheme is to prove the asymptotic formula first for some regular case (say, 
smooth and compactly supported potentials if one considers Schrédinger operators) and 
then use some uniform estimate (say, the CLR estimate) in combination with Lemma A.7 
to extend the asymptotics to more singular cases. 


References 


[1] 
[2] 


[3] 
[4] 


[5] 


[6] 


[7] 


[8] 


[9 


= 


[10] 


(11) 
[12] 


[13] 


[14] 


[15] 


[16] 


[17] 


[18] 


[19] 
[20] 


[21] 


C. Adam, B. Muratori and C. Nash, Multiple zero modes of the Dirac operator in three dimensions, Phys. 
Rev. D 62 (2000), 085026, 9 pp. 

C. Adam, B. Muratori and C. Nash, Chern—Simons action for zero-modes supporting gauge fields in three 
dimensions, Phys. Rev. D 67 (2003), 087703, 3 pp. 

R. Adami and R. Teta, On the Aharonov-Bohm Hamiltonian, Lett. Math. Phys. 43 (1998), 43-53. 

D. Adams and L. Hedberg, Function Spaces and Potential Theory, Grundlehren Math. Wiss., Vol. 314, 
Springer-Verlag, Berlin (1996). 

Y. Aharonov and D. Bohm, Significance of electromagnetic potentials in the quantum theory, Phys. Rev. 
115 (1959), 485-491. 

Y. Aharonov and A. Casher, Ground state of a spin-5 charged particle in a two-dimensional magnetic 
field, Phys. Rev. A 19 (1979), 2461-2462. 

M. Aizenman and E. Lieb, On semi-classical bounds for eigenvalues of Schrédinger operators, Phys. Lett. 
A 66 (1978), 427-429. 

W. Arendt and A.V. Bukhvalov, Integral representations of resolvents and semigroups, Forum Math. 6 
(1994), 111-135. 

J. Avron, I. Herbst and B. Simon, Schrédinger operators with magnetic fields: I. General interactions, 
Duke Math. J. 45 (1978), 847-883. 

A. Balinsky and W.D. Evans, On the number of zero modes of Pauli operators, J. Func. Anal. 179 (2001), 
120-135. 

R. Benguria and M. Loss, On a theorem of Laptev and Weidl, Math. Res. Lett. 7 (2000), 195-203. 

Yu. Berezanski, Expansions in Eigenfunctions of Self-Adjoint Operators, Transl. Math. Monographs, 
Vol. 17, Amer. Math. Soc., Providence, RI (1968). 

F. Berezin and M. Shubin, The Schrédinger Equation, Math. Appl. Soviet Ser., Vol. 66, Kluwer, Dordrecht 
(1991). 

M.Sh. Birman, The spectrum of singular boundary problems, Mat. Sb. (N.S.) 55 (1961), 125-174 
(in Russian); English transl.: Amer. Math. Soc. Transl. 53 (1966), 23-80. 

M.Sh. Birman and V.V. Borzov, On the asymptotics of the discrete spectrum of some singular differential 
operators, Probl. Mat. Phys. 5 (1971), 24-38 (in Russian); English transl.: Topics Math. Phys. 5 (1972), 
19-30. 

M.Sh. Birman and M. Solomyak, On the leading term of the spectral asymptotics for non-smooth elliptic 
problems, Functional Anal. Appl. 4 (1971), 265-275. 

M.Sh. Birman and M. Solomyak, Spectral Theory of Selfadjoint Operators in Hilbert Space, Reidel, Dor- 
drecht (1987). 

M.Sh. Birman and M. Solomyak, Schrédinger operator. Estimates for number of bound states as function- 
theoretical problem, Spectral Theory of Operators, Novgorod, 1989, Amer. Math. Soc. Transl. Ser. 2, 
Vol. 150, Amer. Math. Soc., Providence, RI (1992), 1-54. 

Ph. Blanchard and J. Stubbe, Bound states for Schrédinger Hamiltonians: Phase space methods and ap- 
plications, Rev. Math. Phys. 8 (1996), 503-547. 

M. Braverman, O. Milatovic and M. Shubin, Essential selfadjointness of Schrédinger type operators on 
manifolds, Russian Math. Surveys 57 (2002), 641-692. 

L. Bugliaro, C. Fefferman, J. Frohlich, G.M. Graf and J. Stubbe, A Lieb-Thirring bound for a magnetic 
Pauli Hamiltonian, Comm. Math. Phys. 187 (1997), 567-582. 


[22] 


[23] 


[24] 


[25] 


[26] 


[27] 
[28] 


[29] 


[30] 


[31] 
[32] 


[33] 


[34] 
[35] 


[36] 


[37] 


[38] 


[39] 


[40] 


[41] 


[42] 


[43] 


[44] 


[45] 


[46] 


[47] 
[48] 


Schrédinger operators with singular potentials 513 


L. Bugliaro, C. Fefferman and G.M. Graf, A Lieb-Thirring bound for a magnetic Pauli Hamiltonian. I, 
Rev. Mat. Iberoamericana 15 (1999), 593-619. 

S. Chanillo and R.L. Wheeden, L? -estimates for fractional integrals and Sobolev inequalities with appli- 
cations to Schrédinger operators, Commun. Partial Differential Equations 10 (1985), 1077-1116. 

I. Chavel, Isoperimetric Inequalities. Differential Geometric and Analytic Perspectives, Cambridge Tracts 
in Math., Vol. 145, Cambridge University Press, Cambridge (2001). 

PR. Chernoff, Essential self-adjointness of powers of generators of hyperbolic equations, J. Funct. Anal. 
12 (1973), 401-414. 

F. Cobos and T. Kiihn, Lorentz—Schatten classes and pointwise domination of matrices, Canad. Math. Bull. 
42 (1999), 162-168. 

R. Courant and D. Hilbert, Methods of Mathematical Physics, Vol. 1, Interscience, New York (1953). 

M. Cwikel, Weak type estimates for singular values and the number of bound states of Schrédinger oper- 
ators, Ann. Math. 106 (1977), 93-100. 

H.L. Cycon, R.G. Froese, W. Kirsch and B. Simon, Schrédinger Operators with Application to Quantum 
Mechanics and Global Geometry, Springer-Verlag, Berlin (1987). 

R. De la Bretéche, Preuve de la conjecture de Lieb-Thirring dans le cas des potentials quadratiques 
strictement convexes, Ann. Inst. H. Poincaré Phys. Théor. 70 (1999), 369-380. 

A. Dufresnoy, Un exemple de champ magnétique dans R” , Duke Math. J. 50 (1983), 729-734. 

D.E. Edmunds and W.D. Evans, Spectral Theory and Differential Operators, Clarendon Press/Oxford 
University Press, New York (1987). 

D. Elton, The local structure of zero modes producing magnetic potentials, Comm. Math. Phys. 229 (2002), 
121-139. 

L. Erdés, Magnetic Lieb-Thirring inequalities, Comm. Math. Phys. 170 (1995), 629-668. 

L. Erdés, Dia- and paramagnetism for nonhomogeneous magnetic fields, J. Math. Phys. 38 (1997), 
1289-1317. 

L. Erdés and J.P. Solovej, Semiclassical eigenvalue estimates for the Pauli operator with strong non- 
homogeneous magnetic fields. II. Leading order asymptotic estimates, Comm. Math. Phys. 188 (1997), 
599-656. 

L. Erdés and J.P. Solovej, Semiclassical eigenvalue estimates for the Pauli operator with strong non- 
homogeneous magnetic fields. I. Nonasymptotic Lieb-Thirring-type estimate, Duke Math. J. 96 (1999), 
127-173. 

L. Erdés and J.P. Solovej, The kernel of Dirac operators on S53 and R3, Rev. Math. Phys. 13 (2001), 
1247-1280. 

L. Erdés and J.P. Solovej, Uniform Lieb-Thirring inequality for the three dimensional Pauli operator 
with a strong non-homogeneous magnetic field, Ann. Inst. H. Poincaré 5 (2004), 671-741. Available at 
http://xxx.lanl.gov/pdf/math-ph/0304017. 

L. Erdés and J.P. Solovej, Magnetic Lieb-Thirring inequalities with optimal dependence on the field 
strength, J. Statist. Phys. 116 (2004), 475-506. Available at http://xxx.lanl.gov/pdf/math-ph/0306066. 

L. Erdés and V. Vugalter, Pauli operator and Aharonov—Casher theorem for measure valued magnetic 
fields, Comm. Math. Phys. 225 (2002), 399-421. 

C. Fefferman, The uncertainty principle, Bull. Amer. Math. Soc. 9 (1983), 129-206. 

C. Fefferman, Stability of matter with magnetic fields, Partial Differential Equations and Their Applica- 
tions, Toronto, ON, 1995, CRM Proc. Lecture Notes, Vol. 12, Amer. Math. Soc., Providence, RI (1997), 
119-133. 

K. Friedrichs, Spektraltheorie halbbeschrénkter Operatoren und Anwendung auf die Spektraltheorie von 
Differenzialoperatorer, Math. Ann. 109 (1934), 465-487, 685-713. 

M. Fry, Nonperturbative behavior of 3-dimensional fermionic determinants, paramagnetism of charged 
Fermions, Phys. Rev. D 54 (1996), 6444-6452. 

M. Fry, Paramagnetism, zero modes and mass singularities in QED 1 + 1, 2+ 1, and 3 +1 dimensions, 
Phys. Rev. D 55 (1997), 968-972. 

M. Fry, Fermion determinants, Internat. J. Modern Phys. A 17 (2002), 936-945. 

V. Geyler and E. Grishanov, Zero modes in a periodic lattice of Aharonov-Bohm solenoids, JETP Lett. 75 
(2002), 354-356. 


514 


[49] 
[50] 
[51] 
[52] 
[53] 
[54] 
[55] 
[56] 
[57] 
[58] 
[59] 
[60] 
[61] 
[62] 
[63] 
[64] 
[65] 
[66] 
[67] 
[68] 
[69] 
[70] 
[71] 
[72] 
[73] 
[74] 


[75] 


G. Rozenblum and M. Melgaard 


V. Glaser, H. Grosse and A. Martin, Bounds on the number of eigenvalues of the Schrédinger operator, 
Comm. Math. Phys. 59 (1978), 197-212. 

A. Grigor’ yan and S.-T. Yau, Isoperimetric properties of higher eigenvalues of elliptic operators, Amer. 
J. Math. 125 (2003), 893-940. 

B. Helffer, J. Nourrigat and X. Wang, Sur le spectre l’équation de Dirac (dans R? ou R3) avec champ 
magnétique, Ann. Sci. Ecole Norm. Sup. 22 (1989), 515-533. 

B. Helffer and D. Robert, Riesz means of bounded states and semi-classical limit connected with a Lieb— 
Thirring conjecture, I, J. Asymptot. Anal. 3 (1990), 91-103; Z/, Ann. Inst. H. Poincaré 53 (1990), 139-147. 
H. Hess, R. Schrader and D.A. Uhlenbrock, Domination of semigroups and generalization of Kato’s in- 
equality, Duke Math. J. 44 (1977), 893-904. 

PD. Hislop and LM. Sigal, Introduction to Spectral Theory. With Applications to Schrédinger Operators, 
Appl. Math. Sci., Vol. 113, Springer-Verlag, New York (1996). 

D. Hundertmark, On the number of bound states for Schrédinger operators with operator-valued poten- 
tials, Ark. Mat. 40 (2002), 73-87. 

D. Hundertmark, A. Laptev and T. Weidl, New bounds on the Lieb-Thirring constant, Invent. Math. 140 
(2000), 693-704. 

D. Hundertmark, E.H. Lieb and L.E. Thomas, A sharp bound for an eigenvalue moment of the one- 
dimensional Schrédinger operator, Adv. Theor. Math. Phys. 2 (1998), 719-731. 

V. Ivrii, Microlocal Analysis and Precise Spectral Asymptotics, Springer Monogr. Math., Springer-Verlag, 
Berlin (1998). 

A. Iwatsuka, The essential spectrum of two-dimensional Schrédinger operator with perturbed constant 
magnetic field, J. Math. Kyoto Univ. 23 (1983), 475-480. 

L.V. Kantorovich and G.P. Akilov, Functional Analysis, 2nd Rev. Edition, Nauka, Moscow (1977) 
(in Russian); English transl.: Pergamon Press, Oxford (1982). 

T. Kato, Fundamental properties of Hamiltonian operators of Schrédinger type, Trans. Amer. Math. Soc. 
70 (1951), 195-211. 

T. Kato, Schrédinger operators with singular potentials, Proc. Internat. Symp. Partial Differential Equa- 
tions and the Geometry of Normed Linear Spaces, Jerusalem, 1972, Israel J. Math. 13 (1972), 135-148. 
T. Kato, Perturbation Theory for Linear Operators, Reprint of the 1980 Edition, Classics in Mathematics, 
Springer-Verlag, Berlin (1995). 

T. Kato and K. Masuda, Trotter’s product formula for nonlinear semigroups generated by the subdifferen- 
tials of convex functionals, J. Math. Soc. Japan 30 (1978), 169-178. 

V. Kondratiev, V. Maz’ya and M. Shubin, Discreteness of spectrum and strict positivity criteria for mag- 
netic Schrédinger operators, Comm. Partial Differential Equations 29 (2004), 489-521. 

V. Kondratiev and M. Shubin, Discreteness of spectrum for the magnetic Schrédinger operators, Comm. 
Partial Differential Equations 27 (2002), 477-525. 

A. Laptev, Dirichlet and Neumann eigenvalue problems on domains in Euclidean spaces, J. Funct. Anal. 
151 (1997), 531-545. 

A. Laptev, On the Lieb-Thirring conjecture for a class of potentials, Oper. Theory Adv. Appl. 110 (1999), 
227-234. 

A. Laptev and T. Weidl, Sharp Lieb-Thirring inequalities in high dimensions, Acta Math. 184 (2000), 
87-111. 

A. Laptev and T. Weidl, Recent results on Lieb-Thirring inequalities, Journées Equations aux Dérivées 
Partielles, La Chapelle sur Erdre, 2000, Exp. 20, Univ. Nantes, Nantes (2000). 

H. Leinfelder, Gauge invariance of Schrédinger operators and related spectral properties, J. Operator 
Theory 9 (1983), 163-179. 

H. Leinfelder and C.G. Simader, Schrédinger operators with singular magnetic vector potentials, 
Math. Z. 176 (1981), 1-19. 

H. Leschke, R. Ruder and S. Warzel, Simple diamagnetic monotonicities for Schrédinger operators with 
inhomogeneous magnetic fields of constant direction, J. Phys. A 35 (2002), 5701-5709. 

D. Levin and M. Solomyak, The Rozenblum—Lieb—Cwikel inequality for Markov generators, J. Anal. Math. 
71 (1997), 173-193. 

P. Li and S.-T. Yau, On the Schrédinger equation and the eigenvalue problem, Comm. Math. Phys. 88 
(1983), 309-318. 


[76] 


[77] 


[78] 


[79] 
[80] 


[81] 
[82] 
[83] 
[84] 


[85] 


[86] 
[87] 


[88] 
[89] 


[90] 


[91] 
[92] 


[93] 
[94] 
[95] 
[96] 
[97] 
[98] 
[99] 


[100] 


[101] 


Schrédinger operators with singular potentials 515 


E. Lieb, Bounds on the eigenvalues of the Laplace and Schrédinger operators, Bull. Amer. Math. Soc. 82 
(1976), 751-753. 

E. Lieb, The number of bound states of one-body Schrédinger operators and the Weyl problem, Proc. 
Amer. Math. Soc. Symp. in Pure Math., Vol. 36, R. Ossermann and A. Weinstein, eds, Amer. Math. Soc., 
Providence, RI (1980), 241-252. 

E. Lieb, Kinetic energy bounds and their applications to the stability of matter, Proc. Nordic Summer 
School in Math., Lecture Notes in Phys., Vol. 354, Springer, Berlin (1989), 371-382. 

E.H. Lieb and M. Loss, Analysis, 2nd Edition, Amer. Math. Soc., Providence, RI (2001). 

E.H. Lieb, M. Loss and J.P. Solovej, Stability of matter in magnetic fields, Phys. Rev. Lett. 75 (1995), 
985-989. 

E.H. Lieb, J.P. Solovej and J. Yngvason, Asymptotics of heavy atoms in high magnetic fields: I. Lowest 
Landau band region, Comm. Pure Appl. Math. 47 (1994), 513-591. 

E.H. Lieb, J.P. Solovej and J. Yngvason, Asymptotics of heavy atoms in high magnetic fields: II. Semiclas- 
sical regions, Comm. Math. Phys. 161 (1994), 77-124. 

E.H. Lieb, J.P. Solovej and J. Yngvason, The ground states of large quantum dots in magnetic fields, Phys. 
Rev. B 51 (1995), 10646-10665. 

E. Lieb and W. Thirring, Bound for the kinetic energy of fermions which proves the stability of matter, 
Phys. Rev. Lett. 35 (1975), 687-689; 35 (1975), 1116 (Erratum). 

E. Lieb and W. Thirring, Inequalities for the moments of the eigenvalues of the Schrédinger Hamiltonian 
and their relation to Sobolev inequalities, Studies in Mathematical Physics: Essays in Honor of Valentine 
Bargmann, E. Lieb, B. Simon and A. Wightman, eds, Princeton University Press, Princeton, NJ (1976), 
269-303. 

M. Loss and B. Thaller, Optimal heat kernel estimates for Schrédinger operators with magnetic fields in 
two dimensions, Comm. Math. Phys. 186 (1997), 95-107. 

M. Loss and H.-T. Yau, Stability of Coulomb systems with magnetic fields: III. Zero energy bound states 
of the Pauli operator, Comm. Math. Phys. 104 (1986), 283-290. 

A. Martin, Bound states in the strong coupling limit, Helv. Phys. Acta 45 (1972), 140-148. 

V.G. Maz’ya, On the theory of multi-dimensional Schrédinger operator, Izv. Akad. Nauk SSSR Ser. Mat. 
28 (1964), 1145-1172 (in Russian). 

V.G. Maz’ya, Closure in the metric of the generalized Dirichlet integral, Zap. Nauchn. Sem. Leningr. 
Otdel. Mat. Inst. Steklov (LOMI) 5 (1967), 192-195. 

V.G. Maz’ya, Sobolev Spaces, Springer-Verlag, Berlin (1985). 

V.G. Maz’ya and M. Otelbaev, Imbedding theorems and the spectrum of a certain pseudodifferential op- 
erator, Siberian. Math. J. 18 (1977), 1073-1087 (in Russian). 

V.G. Maz’ya and T.O. Shaposhnikova, Theory of Multipliers in Spaces of Differentiable Functions, 
Monogr. Stud. Math., Vol. 23, Pitman, Boston (1985). 

V.G. Maz’ya and M. Shubin, Discreteness of spectrum and positivity criteria for Schrédinger operators. 
Preprint: arXiv:math.SP/0305278. 

V.G. Maz’ya and LE. Verbitsky, Capacitary estimates for fractional integrals with application to partial 
differential equations and Sobolev multipliers, Ark. Mat. 33 (1995), 81-115. 

V.G. Maz’ya and LE. Verbitsky, The Schrédinger operator on the energy space: Boundedness and com- 
pactness criteria, Acta Math. 188 (2002), 263-302. 

V.G. Maz’ya and LE. Verbitsky, Infinitesimal form-boundedness and subordination criteria for the 
Schrédinger operator, http://front.math.ucdavis.edu/math.FA/0406050. 

M. Melgaard, E.-M. Ouhabaz and G. Rozenblum, Negative discrete spectrum of perturbed multivortex 
Aharonov-Bohm Hamiltonian, Ann. Inst. H. Poincaré 5 (2004), 979-1012. 

M. Melgaard and G. Rozenblum, Spectral estimates for magnetic operators, Math. Scannd. 79 (1996), 
237-254. 

M. Melgaard and G. Rozenblum, Eigenvalue asymptotics for weakly perturbed Dirac and Schrédinger 
operators with constant magnetic fields of full rank, Comm. Partial Differential Equations 28 (2003), 
697-736. 

A. Mohammed and G. Raikov, On the spectral theory of the Schrédinger operator with electromagnetic 
potential, Pseudodifferential Calculus and Mathematical Physics, Math. Topics., Vol. 5, Akademie-Verlag, 
Berlin (1994), 298-390. 


516 


[102] 


[103] 


[104] 


[105] 
[106] 


[107] 


[108] 


[109] 
[110] 
[111] 
[112] 
[113] 
[114] 
[115] 
[116] 
[117] 
[118] 
[119] 
[120] 
[121] 
[122] 
[123] 


[124] 
[125] 


[126] 


[127] 


[128] 
[129] 


G. Rozenblum and M. Melgaard 


A. Molchanov, On conditions for discreteness of the spectrum of self-adjoint differential equations of the 
second order, Trudy Moskov. Mat. Obshch. 2 (1953), 169-199 (in Russian). 

LM. Oleinik, On the essential self-adjointness of the Schrédinger operator on complete Riemannian man- 
ifold, Math. Notes 54 (1993), 934-939. 

E.-M. Ouhabaz, Invariance of closed convex sets and domination criteria for semigroups, Potential Anal. 
5 (1996), 611-625. 

V.V. Peller, Hankel operators of class © p and their applications, Mat. Sb. (N.S.) 113 (1980), 538-581. 
L.D. Pitt, A compactness condition for linear operators on functional spaces, J. Oper. Theory 1 (1979), 
49-54. 

A.Ya. Povzner, On the expansion of arbitrary functions in characteristic functions of the operator —Au + 
cu, Mat. Sb. (N.S.) 32 (1953), 109-156 (in Russian). 

G.D. Raikov, Eigenvalue asymptotics for the Schrédinger operator with homogeneous magnetic potential 
and decreasing electric potential, I. Behaviour near the essential spectrum tips, Comm. Partial Differential 
Equations 15 (1990), 407-434; Comm. Partial Differential Equations 18 (1993), 1977-1979 (Errata). 
G.D. Raikov, Semiclassical and weak magnetic field asymptotics for the Schrédinger operator with elec- 
tromagnetic potential, Ann. Inst. H. Poincaré Phys. Theor. 61 (1994), 163-188. 

G.D. Raikov, Spectral asymptotics for the perturbed 2D Pauli operator with oscillating magnetic fields. 
I. Non-zero mean value of the magnetic field, Markov Process. Related Fields 9 (2003), 775-794. 

G.D. Raikov and S. Warzel, Quasi-classical versus non-classical spectral asymptotics for magnetic 
Schrédinger operators with decreasing electric potentials, Rev. Math. Phys. 14 (2002), 1051-1072. 

M. Reed and B. Simon, Methods of Modern Mathematical Physics. I. Fourier Analysis, Self-adjointness, 
Academic Press, New York—London (1975). 

M. Reed and B. Simon, Methods of Modern Mathematical Physics. IV. Analysis of Operators, Academic 
Press, New York—London (1978). 

M. Reed and B. Simon, Methods of Modern Mathematical Physics. I. Functional Analysis, 2nd Edition, 
Academic Press, New York (1980). 

ES. Rofe-Beketov, Conditions for the self-adjointness of the Schrédinger operator, Mat. Zametki 8 (1970), 
741-751 (in Russian); English transl.: Math. Notes 8 (1970), 888-894. 

G. Rozenblum, Distribution of the discrete spectrum of singular operators, Dokl. Akad. Nauk SSSR 202 
(1972), 1012-1015. 

G. Rozenblum, Asymptotic behavior of the eigenvalues of the Schrédinger operator, Mat. Sb. (N.S.) 93 
(1974), 347-367, 487 (in Russian). 

G. Rozenblum, Domination of semigroups and estimates for eigenvalues, Algebra i Analiz 12 (2000), 
158-177 (in Russian); English transl.: St. Petersburg Math. J. 12 (2001), 831-845. 

G. Rozenblum, Eigenvalue analysis of elliptic operators, Topics Math. Anal., Springer (2005), to appear. 
G. Rozenblum, M. Shubin and M. Solomyak, Spectral theory for differential operators, Partial Differen- 
tial Equations, Vol. 7, Encyclopaedia of Mathematical Sciences, Vol. 64, Springer-Verlag, Berlin (1994), 
1-272. 

G. Rozenblum and M. Solomyak, The Cwikel—Lieb-Rozenblyum estimator for generators of positive 
semigroups and semigroups dominated by positive semigroups, Algebra i Analiz 9 (1997), 214-236 
(in Russian); English transl.: St. Petersburg Math. J. 9 (1998), 1195-1211. 

S. Ruijsenaars, The Aharonov-Bohm effect and scattering theory, Ann. Phys. 146 (1983), 1-34. 

Yu. Safarov and D. Vassiliev, The Asymptotic Distribution of Eigenvalues of Partial Differential Operators, 
Transl. Math. Monographs, Vol. 155, Amer. Math. Soc., Providence, RI (1997). 

J. Schwinger, On the bound states of a given potential, Proc. Nat. Acad. Sci. U.S.A. 47 (1961), 122-129. 
Z. Shen, On moments of negative eigenvalues for the Pauli operator, J. Differential Equations 149 (1998), 
292-327. 

Z. Shen, On moments of negative eigenvalues for the Pauli operator, J. Differential Equations 151 (1999), 
420-455. 

I. Shigekawa, Spectral properties of Schrédinger operators with magnetic fields for a spin 5 particle, 
J. Func. Anal. 101 (1991), 255-285. 

M. Shubin, Spectral theory of elliptic operators on noncompact manifolds, Astérisque 207 (1992), 35-108. 
M. Shubin, Private communication (2003). 


130] 
131] 
132] 


133] 
134] 


135] 
136] 
137] 
138] 
139] 
140] 
141] 
142] 
143] 
144] 
145] 
146] 
147] 


148] 


149] 
150] 


151] 
152] 


153] 
154] 


155] 


Schrédinger operators with singular potentials S17 


B. Simon, On the growth of the number of bound states which increase in potential strength, J. Math. Phys. 
10 (1969), 1123-1126. 

B. Simon, Quantum Mechanics for Hamiltonians Defined as Quadratic Forms, Princeton University Press, 
Princeton, NJ (1971). 

B. Simon, The bound states of weakly coupled Schrodinger operators in one and two dimensions, Ann. 
Phys. 97 (1976), 276-288. 

B. Simon, Universal diamagnetism of spinless Boson systems, Phys. Rev. Lett. 36 (1976), 1083-1084. 

B. Simon, An abstract Kato’s inequality for generators of positivity preserving semigroups, Indiana Univ. 
Math. J. 26 (1977), 1067-1073. 

B. Simon, Kato’s inequality and the comparison of semigroups, J. Funct. Anal. 32 (1979), 97-101. 

B. Simon, Maximal and minimal Schrédinger forms, J. Oper. Theory 1 (1979), 37-47. 

B. Simon, Trace Ideals and Their Applications, Cambridge Univivesity Press, Cambridge (1979). 

B. Simon, Functional Integration and Quantum Physics, Academic Press, New York (1979). 

A.V. Sobolev, Asymptotic behaviour of the energy levels of a quantum particle in a homogeneous magnetic 
field, perturbed by a decreasing electric field. I, Probl. Mat. Anal. 9 (1984), 67-84 (in Russian); English 
transl.: J. Soviet Math. 35 (1986), 2201-2212. 

A.V. Sobolev, Asymptotic behavior of energy levels of a quantum particle in a homogeneous magnetic 
field perturbed by a decreasing electric field. II, Probl. Mat. Fiz. 11 (1986), 232-248 (in Russian). 

A.V. Sobolev, Asymptotics of the discrete spectrum of the Schrédinger operator in an electric and a ho- 
mogeneous magnetic field, Zap. Nauchn. Sem. Leningrad. Otdel. Mat. Inst. Steklov (LOMI) 182 (1990), 
131-141 (in Russian); English transl.: J. Soviet Math. 62 (1992), 2807-2814. 

A.V. Sobolev , On the Lieb-Thirring estimates for the Pauli operator, Duke Math. J. 82 (1996), 607-635. 
A.V. Sobolev, Lieb-Thirring inequalities for the Pauli operator in three dimensions, Quasiclassical Meth- 
ods, Minneapolis, MN, 1995, IMA Vol. Math. Appl., Vol. 95, Springer-Verlag, New York (1997), 155-188. 
A.V. Sobolev, Quasiclassical asymptotics for the Pauli operator, Comm. Math. Phys. 194 (1998), 
109-134. 

K. Tachizawa, On the moments of the negative eigenvalues of elliptic operators, J. Fourier Anal. Appl. 8 
(2002), 233-244. 

H. Tamura, Asymptotic distribution of eigenvalues for Schrédinger operators with homogeneous magnetic 
fields, Osaka J. Math. 25 (1988), 633-647. 

H. Tamura, Asymptotic distribution of eigenvalues for Schrédinger operators with homogeneous magnetic 
fields, II, Osaka J. Math. 26 (1989), 119-137. 

H. Tamura, Resolvent convergence in norm for Dirac operator with Aharonov-Bohm field, J. Math. Phys. 
44 (2003), 2967-2993. 

B. Thaller, The Dirac Equation, Texts Monographs Phys., Springer-Verlag, Berlin (1992). 

S. Thangavelu, Lectures on Hermite and Laguerre Expansions, Math. Notes, Vol. 42, Princeton University 
Press, Princeton, NJ (1993). 

N. Ural’ceva, The nonselfadjointness in L?(R") of elliptic operators with rapidly increasing coefficients, 
Zap. Nauchn. Sem. Leningr. Otdel. Mat. Inst. Steklov (LOM) 14 (1969), 288-194 (in Russian). 

LE. Verbitsky, Nonlinear potentials and trace inequalities, The Maz’ya Anniversary Collection, Oper. 
Theory Adv. Appl. 110 (1999), 323-343. 

T. Weidl, On the Lieb-Thirring constants Ly, for y > 1/2, Comm. Math. Phys. 178 (1996), 135-146. 
T. Weidl, Another look at Cwikel’s inequality, Differential Operators and Spectral Theory, Amer. Math. 
Soc. Transl. Ser. 2, Vol. 189, Amer. Math. Soc., Providence, RI (1999), 247-254. 

J. Weidmann, Linear Operators in Hilbert Spaces, Springer-Verlag, New York—Berlin (1980). 


CHAPTER 7 


Multiplicity Techniques for Problems 
without Compactness 


Sergio Solimini 
Dipartimento di Matematica, Politecnico di Bari, 70125 Bari, Italy 
E-mail: solimini@ dm.uniba.it 


Contents 
Introduction: ieee See Ra bra es BS Eh See he ee Se ee Basle Roe ae aed 521 
1. Statement of the problems and sketch of the existence results... 2... ......0........00.0. 522 
1.1. Elliptic problems at critical growth ona bounded domain ....................000. 522 
1.2. Elliptic problems at subcritical growth on the whole domain ................-2004 524 
1.3. Concentration—-compactness tools . 2... . eee 527 
LAS Natural constiainte<.: ts i:a7 ase kee Seas ee gh Ola dete. a GR ee Se eas da need Beas do 536 
1.5. Existence of a nontrivial solution for the problem at critical growth... ............00.0. 539 
1.6. Existence of a nontrivial solution for the problem on the whole domain ............... 540 
2. Approximating problems and compactness of balanced sequences ...........0-00 0000 ee 541 
2.1. Avoiding concentration... 2... ee 541 
2.2. Avoiding escaping masses .. 2... ee 546 
3 Decay CStimates ssi t6 8 eh ekg a a BG Ak gel a aa, Bn te be od 553 
3.1. Decay estimates near concentration points... 2... 2... ee 554 
3.2. Decay estimates at drift points... 2... . ee ee 564 
4. Multiplicity-tesults' ce20 BS a SO ad ee ae ke ed oa a ee ee 570 
4.1... Krasnoselski genus. ey 246053 ecace es OR A aN Sie eA de eae He ee dae 571 
4.2; ‘Genus:of aSyMmMetric Set goes. eke ee SR EG ek ee Bua wae, Goning Some dete e Rew skle ees 572 
4.3. Min—max classes on the natural constraint ... 2... 2.2... 2. ee ee ee 578 
4.4. Min—max classes on the double natural constraint .. 2... . 0.0.0.0... .02.00000. 581 
4.5. An estimate on the Morse index .. 2... 2... 2 ee 584 
4.6. Multiple solutions to the problem at critical growth... 2... 2. ee. 587 
4.7. Multiple solutions to the problem on the whole domain ....................000. 590 
S*Coneluding remarks: 36.2..dc6 4 3, We psa Ma het eR eee a We le Mogae, tees bk ore eS ASSAD as 593 
5.1. Review on the assumptions and open problems ...............0.00 020000000. 593 
5.2. Estimates inlower dimension .......... 0... 0.0000. e eee ee eee 594 
Acknowledgment js vacick Sek ina (Ad in fae act oh Ee Seca se a ED GS Bok ees bos eee as seg 598 
REPETENCES ee atti ad ints a yg Beene het he) Pieateae ee tek: gates Cindy Uy tari ott eta! Ge 3, ats 598 


HANDBOOK OF DIFFERENTIAL EQUATIONS 
Stationary Partial Differential Equations, volume 2 
Edited by M. Chipot and P. Quittner 

© 2005 Elsevier B.V. All rights reserved 


519 


Multiplicity techniques for problems without compactness 521 


Introduction 


The aim of this survey relies on focusing some recent multiplicity results for nonlinear 
problems with a lack of compactness which could probably find new and different appli- 
cations. The corresponding existence results are well known long before but a full under- 
standing of the multiplicity problem has required more specific and recent techniques. Here 
we shall show those techniques by stressing on the geometric ideas underlying them. More 
precisely, two main problems will be addressed: 

1. Elliptic problems at critical growth on a bounded domain. 

2. Elliptic problems at subcritical growth on the whole domain. 

For both the above problems there is a lack of compactness which is due to the existence 
of extremely concentrated solutions in case | and to the existence of solutions whose cen- 
ters of mass escape to infinity in case 2. In both cases the existence results are available 
thanks to suitable hypotheses on the linear term which make the compactness degeneracy 
increase the functional which is going to be minimized. Thus deviation from compact- 
ness is possible in principle but it is not advantageous, under different hypotheses on the 
lower-order terms one would easily show nonexistence results. This survey includes the 
results in [13,19,20,43], some parts of which are borrowed with minor modifications, and 
it is in large part devoted to a careful analysis of the two above problems following mainly 
[19] and [13]. For the common features shared by these problems, they well offer the op- 
portunity to clarify and to focus the ideas and the techniques employed in those works. 
Moreover, we shall make the exposition self-contained as far as possible and organized in 
a heuristic way. Nevertheless, a good knowledge of the use of the variational and topolog- 
ical methods in nonlinear analysis and some familiarity with the study of nonlinear elliptic 
equations is required to the reader. 

The exposition begins with an introductory part in which we recall the known facts con- 
cerning the two already mentioned problems and, after introducing suitable concentration— 
compactness tools, briefly sketches the main ideas which lead to prove the existence of a 
nontrivial solution, recovering compactness thanks to suitable estimates on the energy lev- 
els. In Section 2 we shall prove the compactness theorems which show how, substituting 
the Palais-Smale sequences with the sequences of solutions of approximating problems, 
the concentration—compactness tools introduced in the first section lead to complete com- 
pactness results. Section 3 is devoted to the proof of some decay estimates, inspired by 
the analysis of some particular cases, employed in the previous section. Section 4 con- 
cerns the proof of the multiplicity theorems, which will be given after a preliminary part 
in which the notion of genus, together with a recent variant, is introduced and employed to 
construct the suitable min—max approach. Finally, in Section 5 some concluding remarks 
are stated and a result which falls out of the main hypotheses assumed here is shown. 
Further introductory indications are given at the beginning of each section. 


Notation. Throughout the paper we make use of the following notation: 
e {2 denotes a bounded subset of R’. 
e LP(2),1<p<4+0, 2C IR, denotes a Lebesgue space, the norm in L?({2) is 
denoted by || - Il p. 
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Hy (2), 2 CR, denote the Sobolev space obtained as closure of Coe (92), with 
respect to the norm 


1/2 
llul| = I vu 
2Q 


H7!(Q), 2 CRN, denotes the dual spaces of a (92). 

Ifue jek (2), 2 CRN, and if there is no risk of ambiguity, we denote also by u its 
extension to R™ made by setting u =0 on R% \ Q. 

S denotes the Sobolev constant, i.e., S = inf{||Vul|5/|ull5. | u € Hg (2), u AO}. 

We denote by 41 < A2 <A3 <--- CAn <--- the sequence of the eigenvalues of 
the Laplacian operator —A on He (2) and by 9}, ¢2,...,@n,... the corresponding 
sequence of orthonormal eigenvectors, we set FE, = Span{@1, G2, ..-, Qn}. 

For every real number c we shall say that a sequence (uy)neN is a Palais—Smale 
(briefly PS) sequence for the functional J: H! — R at level c if the following two con- 
ditions hold: 

(1) Tn) > ¢; 

(2) dI (un) > 0 in H~!, where dJ is the Fréchet derivative of J. 

We shall briefly say that (u,)nen is a PS sequence if there exists a level c € R such that 
(Un)neN iS a PS sequence at level c. 


1. Statement of the problems and sketch of the existence results 
1.1. Elliptic problems at critical growth on a bounded domain 


Let us consider the critical growth problem 
ee jul? ~2u+au in, (CP) 
u=0 on 082, 


where Q is an open regular subset (without any shape condition) of RY (N > 3), 
2* =2N/(N —2) is the critical Sobolev exponent for the embedding of Hy (92) into 
L?(s2), and 4 > 0. Several people have got involved with this problem (see [2,3]) and 
here, for the reader’s convenience, we summarize the main known results in the field. 

1. If A <0, the Pohozaev identity (see [37]) allows us to say that problem (CP) has, in 
general (for a star-shaped (2), no nontrivial solution. 

2. There exists a constant 4* € [0, A,[ such that (CP) has a positive solution if 7 € 
]JA*, Ail, where A, is the first eigenvalue of —A defined on As (2). When N >4 
then 4.* = 0 (see [11]). The existence of a nontrivial solution also for 4. > A, has been 
subsequently proved in [12]. In the three-dimensional case and when S2 is a ball 
then 4* = A,/4. Moreover, by using also in this case a suitable version of Pohozaev 
identity we know that, for A € JO, A*[, (CP) has no radial solution (see [11,12]) but it 
is still unknown if there exist nonradial solutions (changing sign) to (CP). 
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3. If N >4 and &2 is a ball, then for any 4 > 0, (CP) has infinitely many changing sign 
solutions (which sometimes cannot be radial, as shown in [2,3]) which are built by 
using the particular symmetry of the domain {2 (see [24]). 

4. If N >7 and 2 isa ball, then for each A > 0, (CP) has infinitely many changing sign- 
radial solutions, see [39] and a previous paper by Cerami, Solimini and Struwe [14], 
where it is also shown that for N > 6, (CP) has at least two (pairs of ) solutions on 
any smooth bounded domain. 

5. When 4 < N < 6 and @ is a ball there exists a constant A* > 0 such that (CP) has 
no changing sign-radial solution if 4 €]0, A*[. So the bound N > 7 in the previous 
result cannot be removed (see [2,3]). 

6. In [19] the question about existence of infinitely many solutions to problem (CP), for 
any bounded smooth domain 2 C R% in the case N > 7, is affirmatively answered. 
Furthermore, by the above mentioned result in [2,3], the compactness arguments, 
which can be also employed in the radial case, cannot be extended to lower values 
of N. 

7. Finally, in [20] it is shown that, for A €]0,A,[ and N > 4, problem (CP) has at least 
x + 1 (pairs of ) solutions (NV + 1 for A close enough to 0) improving thus the result 

n [14]. Such result has been extended in [15] to the case A > A). 
The main difficulty in dealing with problem (CP) is the existence of noncompact Palais— 
Smale sequences (PS sequences) of the corresponding functional 


“1 Pe See gs 
hUW)=5 |Vu| 5 |u| ~ 5x lul~ , (1.1) 
2 2 2 


defined on the Hilbert space Ht (2). The behavior of noncompact PS sequences has been 
studied in [45] which, roughly speaking, assures the existence of a subsequence approx- 
imated by its weak limit plus terms which tend to concentrate around a finite number 
of points (see Theorem 1.6). This result allows a precise description of the behavior of 
noncompact PS sequences of the functional J, and an estimate of their possible levels, 
suggesting the idea to look for good levels in order to get compactness. We shall employ 
this analysis in conjunction with other suitable compactness techniques to deal with the 
multiplicity problem. Then, following [19], we shall show as, in dimension N > 7, every 
min—max admissible class produces precompact PS sequences. This will follow as a con- 
sequence of a uniform bound theorem stated for bounded sets U of solutions to 
2 : 
oak utau inQ, (SP) 
u=0 on 022, 


with p € [2, 2*]. This result will require suitable a priori estimates on some norms of the 
functions in U. Such estimates will be employed to the aim of finding a suitable control on 
the functions and on their derivatives and, finally, a local Pohozaev identity will allow the 
proof of the following uniform bound theorem. 


THEOREM 1.1 (Uniform bound through concentration estimates). Let N >7 and U bea 
bounded set in Hy (2) whose elements are solutions, for a fixed . > 0, to problems (SP), 
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for p varying in [2, 2*]. Then U is uniformly bounded, i.e., there exists a constant C > 0 
such that 


sup sup |u(x)| <C. 
ucU xeQ 


The above result is equivalent to a compactness property in H '(Q) (see [10]) which 
allows uniform L® estimates in the case of a precompact set of solutions. Though there 
is a lack of compactness for PS sequences, we have compactness for the bounded sets of 
solutions. Thus the key idea, in the case of a critical growth, relies in using the variational 
methods to solve slightly subcritical problems, where the usual arguments based on PS 
sequences produce solutions, and then to pass to the limit on such a set of solutions. In the 
light of these considerations, it becomes evident that Theorem 1.1 plays a crucial role in this 
program of work, indeed its proof has involved the major difficulties. Furthermore, we shall 
show how this technique allows to apply classical min—max arguments to problem (CP) 
and to prove, in this way, the existence of infinitely many solutions, as it is stated in the 
following theorem. 


THEOREM 1.2 (Infinitely many solutions to (CP) in large dimension). If N > 7, then prob- 
lem (CP) admits infinitely many solutions. 


As we have just observed, analogous multiplicity results, like the existence of infinitely 
many radial solutions to (CP) when {2 is a ball, can be obtained from Theorem 1.1 in the 
same way as Theorem 1.2 and so the uniqueness result in [3], Theorem A, leads to the 
following remark. 


REMARK 1.1. The restriction N > 7 in Theorem 1.1 cannot be removed. Indeed, the the- 
orem is false for N < 6. 


Theorem 1.2 does not give any answer to the existence of infinitely many solutions 
to (CP) when N < 6. In such a case it is only known the negative answer for radial solu- 
tions and the affirmative one for symmetric domains. Here we shall show through different 
techniques that when N > 4, for A €]0,A1[, problem (CP) has at least x + 1 (pairs of ) 
solutions (see [20]). 


1.2. Elliptic problems at subcritical growth on the whole domain 


Let us consider the problem 


—Au+a(x)u=|ul?-2u inR, (P) 

ue H! (RY ), 
where N > 2, p> 2 and p <2N/(N — 2) when N > 2, and the potential a(x) is a con- 
tinuous function, positive in RY, except at most a bounded set, satisfying suitable decay 
assumptions. We do not impose any symmetry property to a(x). 
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Problems like (P) naturally arise in various branches of Mathematical Physics, indeed 
the solutions to (P) can be seen as solitary waves (stationary states) in nonlinear equations 
of the Klein—Gordon or Schrédinger type, moreover, they present specific mathematical 
difficulties that make them challenging to the researchers. 

The solutions to problem (P) can be searched as critical points of the energy functional 
1: H'(RY) = R defined by 


I= sf (|Vul? + a(x)u?) dx — ae |u|? dx. (1.2) 


The usual variational methods, that allow to prove the existence of infinitely many solu- 
tions to (P) in a bounded domain, cannot be straightly applied to 7. Indeed, the embedding 
j: H'(R%) > L?(RY%) is continuous but not compact, therefore the basic Palais—Smale 
condition is not satisfied by J at all the energy levels. This difficulty can be avoided when 
a(x) enjoys some symmetry. Indeed, the first known results have been obtained consid- 
ering a(x) = a(|x|) or even a(x) = doo € R™ \ {0} (see [8,9,16,17,35,42]). In this case, 
the restriction of J to H} (R"), the subspace of H!(R™) consisting of spherically sym- 
metric functions, restores compactness, because the embedding of H} (RY) into L? (RY) 
is compact. So, the existence of a positive solution to (P) can be proved either by using 
mountain pass theorem or by minimization on a natural constraint, while the existence of 
infinitely many solutions follows by standard minimax arguments. Moreover, it is worth 
recalling that, still under the assumption a(x) = a(|x|), one can also find the existence 
of infinitely many nonradial changing sign solutions, breaking the radial symmetry of the 
equation (see [6] and reference therein). 

When a(x) does not enjoy any symmetry property, the problem becomes more difficult 
and even proving the existence of one positive solution is not a trivial matter. This situation 
requires a deeper understanding of the nature of the obstructions to the compactness and 
the use of more subtle tools. Most of the researches have been concerned with the case 


lim a(x)=dgo >0 (1.3) 


|x| +00 
so that (P) can be related to the “problem at infinity”, 
—Au+dgou=|ul?-u in RY. (Poo) 


A first answer to the existence question has been given proving that, in some cases, being 
true some inequalities relating (P) and (P.o), the concentration—compactness principle can 
be applied and (P) can be solved by minimization [28]. This is the case, for instance, when 
a(x) is a continuous function that, besides (1.3) and some decay assumptions, satisfies 


0 <8; <a(x)<do WxeR. (1.4) 
Subsequently, a careful analysis of the behavior of the Palais—Smale sequences (see [4,7]) 


has allowed to state that the compactness can be lost (in the sense that a PS sequence does 
not converge to a critical point) if and only if such a sequence breaks into a finite number 


526 S. Solimini 


of solutions to (Poo) which are centered at points which go to infinity. As a consequence, it 
has been possible to give an estimate of the energy levels in which the PS condition fails in 
terms of the energy of such masses and to face better some existence and multiplicity ques- 
tions for (P). Indeed, the existence of a positive solution to (P) has been proved (see [4]) 
even when a ground state solution cannot exist, that is, for instance, when, besides (1.3) 
and suitably decay assumptions, the potential satisfies the condition a(x) > dgo Vx € RY; 
moreover, under conditions (1.3), (1.4) and a suitable decay at infinity, it has been shown 
the existence of a changing sign solution in addition to the positive one (see [33]). 

To conclude this brief review of known results, let us mention that there is some other 
work involving the use of variational methods to deal with standing waves of nonlinear 
Schrédinger equations. Some of these papers mainly deal with the existence of solutions 
to (P) using mountain pass and comparison arguments. See, e.g., [21,38] as well as the 
references therein. In particular, we point out that in [38] the existence of a positive and a 
negative solution is proved, provided 


(i) infa(x) >0, (ii) lim a(x) =+00, (1.5) 
RN |x| +00 


while in [5] the existence of a third changing sign solution is shown. 

Some other papers study cases in which the potential a(x) possesses nondegenerate crit- 
ical points and depends on a parameter, i.e., it appears like ay,(x) = a(hx), and contain 
results of multiplicity of positive solutions under restrictions on the size of h (see [1,23,36] 
and for a(x) of a special form [34]). Finally we remind that, under assumptions of period- 
icity on a, (P) has been shown to posses infinitely many solutions (see [18]). 

Following [13], we shall assume the function a to satisfy the following conditions. 

(a1) a€C!(R",R); 

(az) liminf),|+ +00 A(X) = Age > 0; 


(a3) $4(x)e"*! —> +00 Va > 0, where Vx € RY \ {0}, ¥ = x/|xxI; 
|x| +00 
(aq) there exists a constant c > 1 such that 


3 
|Vr,a(x)| < c(t) Vx ER: |x] >é, 
Xx 


where V;,a(x) denotes the component of Va(x) lying in the hyperplane orthogonal to x 
and containing x. 

Therefore, in such a setting, we shall prove the next theorems. The ingredients of the 
proof recall the techniques and the estimates employed in the previous case for the problem 
at critical growth on a bounded domain. The analogous of the subcritical problem (SP) is, 
in this case, the same problem (P) on a bounded domain or, more specifically, on a ball B, 
centered in the origin, with homogeneous Dirichlet boundary conditions. Given r > 0, we 
shall therefore consider the approximating problem 

— p=) ‘ 
Cae u_ in B,(O), (AP,) 
u=0 on 0B,(0). 
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The first theorem states a compactness property of the bounded sets of solutions to the 
approximating problems. 


THEOREM 1.3. Assume that a(x) satisfies (a,)(a4). Let U C H'(R%) be a bounded set 
consisting of solutions to (AP,) for some r > 0. Then U is a precompact subset of H' (IR), 


From such compactness property we shall deduce the infinite multiplicity result. 


THEOREM 1.4. Jf a(x) satisfies the assumptions (a\)—(a4), then (P) has infinitely many 
solutions. 


Let us consider a sequence of balls in RY, B,,, (0) = {x € RY: |x| <Mn},1T — +0, 
and the related problems (P,,) = (AP,,,) approaching (P). ree 

Since it is possible to prove that, for every n, (P,,) possesses infinitely many solutions, 
obtained by constructing infinitely many critical levels for the related functionals as min- 
imax on suitable classes of functions, it is a natural idea considering sequences {u,} of 
solutions to (P;,), corresponding to minimax classes of the same type, and then trying to 
pass to the limit. 

Clearly, once again, we need to prove that such sequences are precompact. Hence some 
additional tool is needed to control the situation. This is again a local Pohozaev-type in- 
equality that, combined with some uniform decay estimates and integral bounds on any 
bounded sequence of solutions to (P,,), allows to conclude that, under our assumptions, 
the lack of compactness due to translations cannot occur for such sequences because it is 
possible, in principle, but it is not convenient in order to minimize the functional. 


REMARK 1.2. It is worth pointing out that, if in (P) we replace R“ by RY \ 2, where 
Q is any bounded smooth open set in R”, Theorem 1.4 is still true, because the arguments 
we shall develop still hold after very simple modification. 


1.3. Concentration—compactness tools 


The presence of the critical exponent in the Sobolev embedding and the unbounded mea- 
sure of the domain does not allow using the classical compactness techniques based on 
Rellich theorem but requires more fine tools as the ones studied by Lions in [28,29]. Com- 
pactness theorems are due to Struwe [45,46] for the problem at critical growth and to Benci 
and Cerami [7] for the problem on the whole domain. We shall follow the approach pur- 
sued in [42], where a sufficiently general statement including the two previous results is 
given. To this aim let us begin by introducing some terminology. 

We shall call scaling of center xo and modulus o the mapping p:x +> x9 + 0(x — x0). 
In order to have always the possibility to compose two scalings, we shall include among 
them also the translations, which are the product of two scalings with inverse moduli and 
different centers. In such a case there is no center, the modulus is of course | and the func- 
tion is determined by the translation vector. If (0,)nen is a sequence of scalings we shall 
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say that it is diverging by concentration if the corresponding sequence of the moduli di- 
verges to +00. We shall say that it is diverging by vanishing if the corresponding sequence 
of the moduli converges to zero and that it is diverging by translation if the corresponding 
sequence of the moduli is bounded and bounded away from zero and the corresponding se- 
quence of the centers or of the translation vectors is diverging. We shall say that (Oy) nen iS 
diverging if every subsequence admits a subsequence which is diverging by concentration 
or by vanishing or by translation. Two sequences of scalings (Pn )nen and (0), )nen are said 
to be mutually diverging if the sequence ((p,)~! o P!, nen is diverging. If p is a scaling 
with modulus o and u is a function defined on R’, for a € R fixed, we shall refer to the 
function A%u o p as the scaled function u by p and we shall denote it by the symbol p(u). 
Fixed 1 < p <+0n, we shall take a = N/p in order to keep invariant the L? norm and 
a = N/p*, for p < N, to keep invariant the H'-? norm. We shall transfer to the scalings 
of the functions the same terminology which we have introduced for the scalings of the 
variable. 

It turns out that a sequence of scalings (07 )nen is diverging if for every u the sequence 
(Pn (U))nen Weakly converges to zero or, equivalently, if there exists at least one function 
u #0 such that ((,(u))ncen weakly converges to zero. In such a case, we can pass to a 
subsequence which is diverging by concentration or vanishing or translation. 


DEFINITION 1.1. Let U c H!:?(RN) be a bounded subset, we shall say that U has a 
bounded scale if, for every diverging sequence of scalings (0,)nen and for every sequence 


(Un)neN C U, the sequence of scaled functions (~,(Uun))nen weakly converges to zero 
in L?’ (RY). 


The following theorem has been proved in [42]. 


THEOREM 1.5. Let (Un)nen be a given bounded sequence of functions in H}-P(RN), with 
index p satisfying 1 < p < N. Then, replacing (Un)nen with a suitable subsequence, we 
can find a sequence of functions (y;)ien belonging to H'-? (RN) and, in correspondence 
of any index i, we can find a sequence of scalings (01, ien in such a way that the sequence 
(pi, (~)i)ieN is summable in H}-P(RN), uniformly with respect to n, and that the sequence 
(Uy — Vien pi, (P)i nen Converges to zero in L?’. Moreover, we have that, for any pair of 
indexes i and j, the two corresponding sequences of scalings (po! ien and (02 Jien are 
mutually diverging, that 


+00 
Yi ligill?, <™ (1.6) 
i=0 


where M is the limit of (||un IT p)neN: and that the sequence (un — Vien pl, (~)i nen CON- 
verges to zero in H':P (RY) if and only if (1.6) is an equality. 


REMARK 1.3. We notice that the above theorem still holds in the more general context 
of Lorentz spaces L(p*,q) for g > p, it does not hold in the case g = p. Moreover, 
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it is equivalent to state the compact embedding of bounded subsets of H!:? (RN) with a 
bounded scale into L(p*, q) for g > p (see [42]). 


REMARK 1.4. In the above theorem all the limits g; are the weak limits of ey Gg). 
Since for any two indexes i, j the corresponding sequences of scalings are mutually di- 
verging, there exists at most one index 7 such that pi, admits the limit scaling. We shall 
denote by 0 such an index. Thus, it is not restrictive to assume pe = id and so that @ is the 
weak limit of the sequence. We always reserve the index 0 to this aim, by taking go as the 
weak limit of (Uy )nen even when g = 0 and it does not need to be taken into account in 
Theorem 1.5. For i > 1 we can suppose, by passing to a subsequence, that every sequence 
(p),neN is diverging by concentration or by vanishing or by translation. 


It is quite clear from the above theorem that the deviation from compactness for a PS 
sequence of the problem at critical growth on a bounded domain can be controlled by se- 
quences of scalings only diverging by concentration. Whereas, for the subcritical problem 
on the whole domain the analogous phenomenon can be controlled in L? by scalings only 
diverging by translation. 


DEFINITION 1.2. Let (Un)nen C H'?(R%) be a given sequence. We shall say that 
(Un)neNn is a fragmented sequence in H LP or, respectively, in L% if there exists a finite 
number k > | of functions go, ¢1,..., ¢, belonging to H Lp (RY ) and in correspondence 
of any index i > 1, there exists a sequence of mutually diverging scalings (po! ien such that 
the sequence (Un — go — >; pi (~)i neN COnVerges to zero in H LPRY) or, respectively, 
in L4, 


DEFINITION 1.3. Let (Un)nen be a fragmented sequence. In the case all of the pi, for 
i > 1, are diverging by concentration, we shall say that the sequence is concentrating. If all 
of the o; for i > 1, are diverging by translation we shall say that the sequence is broken. 


Now we are in a position to apply the above results to the analysis of the two elliptic 
problems under consideration. Let us begin with problem (CP). 


1.3.1. Concentrating sequences. Given o > 0 and x € RN, let us consider the following 
scaled function 


pl) =ug:xhR oN u(x +o(x — x), 


where the choice of the exponent a = N/2* makes the scaling operation p keep constant 
the norms || Vig ||2 and ||u||2*. 

In order to produce estimates on the values of solutions u to (SP), we observe that v = |u| 
(extended by zero out of S2) solves 


—Av < by" !+4, 


EI 
veH'(R%), v>0, v 
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in the sense of distributions, where b is any coefficient greater than one and A = 
—inf(bs? ~! —sP—! — js) (taken for 1 < Dp <2*, s > 0) is a constant which does not 
depend on u and p. Since b can be trivially normalized, we shall always take b = | in (EI). 
So most of the estimates employed for the solutions to (SP) will be derived for solutions 
to (ED) in H! (RY) and this will let us free from caring about the sign of u or taking into 
account the domain £2. 


DEFINITION 1.4. Let (un)nen be a given sequence. We shall say that (uy )nen iS 
e acontrolled sequence if each uy is a solution to (ED, 
e abalanced sequence if each uy solves (SP) for some p € [2, 2*]. 


REMARK 1.5. As we have already pointed out, the absolute value of every solution to (SP) 
(under an extension by zero out of §2 and multiplied by a constant) is also solution to (EI). 
Therefore any sequence consisting, term by term, of the absolute value of a balanced se- 
quence is a controlled sequence. On the other side, when we shall deal with controlled 
sequences, we shall know that each term is positive and that 2 = R. 


REMARK 1.6. Let (Un)nen be any PS sequence for J,. Then, if a sequence of functions 
(Gi )ieN 18 as in Theorem 1.5, for every i > 1, g solves (CP) in H! (RY) with 2 = 0 and, 
in particular, (EI) with A = 0. 


Since every solution to (ED) with A = 0 has the Hy norm greater or equal to a positive 
constant (see Remark 1.10), then from the above results we get the existence of a con- 
stant C > 0 such that ||g;|| Hi > C for every i > 1. Since the sequence of such norms is 
summable, one can conclude that there are only finitely many g;. Therefore we are lead to 
recall the main result due to Struwe in [45] as a corollary of Theorem 1.5 and so we have 
the following statement which is appropriate to deal with the present situation. 


THEOREM 1.6. Let (Un)nen be a noncompact PS sequence. Then, by replacing (Un)neN 
with a suitable subsequence, there exists a finite number k, depending on a bound M on 
[lun lh (namely k < MS~N/?, where S is the Sobolev constant), of global solutions 9; 
to (CP) in H'(R%) with 4 =0 with corresponding k sequences of mutually diverging 
scalings (01, nen with respective concentration points ae and diverging moduli a} (i.e., 
limy— +00 ot = +00) such that 


k 
un — >> pi(Gi) > vo in Hy(@), (1.7) 
i=l 


where Qo is the weak limit of the sequence and solves (CP). 


PROOF. Let (Un)nen be a PS sequence and let vy, € Hy minimize the distance from 
ey pi(yi) in H'(R%) for every n ¢ N. Then we have v, — ya pi(gi) > 0 
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in H'(R"). We notice that (Un)neN iS a PS sequence, since all of the g are solutions 


to (CP) in H!(R%). Then, by an integration by parts, by denoting by ¢, a small term in the 
H—! norm, we get 


/ | Vn — vn) | dx 
RN 
2 
=f | V(un — Up)|" dx 
2 
== f Abn ~ dy = v9) dx 
2 
= (unl? ~7utn _ lal te +AUn — Un) + En) (Un — Un) dx 
2 
aa (lunl? ~7utn = ital ote +AUn — Un)) (Un — Un) dx 
2 
+f En (Un — Vy) AX. 
2 


. 2 * * See < Ea 
Since wu, and v, are bounded in L? , \un|* 2u,y and |vp | 2y, are bounded in L?” . More- 


over, by Theorem 1.5 we know that vu, — vy, > 0 in LL so we have the first term on the 
right-hand side converging to zero by duality. Furthermore, since u, and v, are bounded 
in H'(R) and ¢, > 0 in H~! we have that also the second term on the right-hand side 
converges to zero in H! and so the thesis is proved. 


Theorem 1.6 says, in other terms, that from any noncompact PS sequence we can ex- 
tract a concentrating sequence in H!. Given any concentrating sequence, we shall also 
consider the scalings pi, and the limit functions g; (which are not uniquely determined by 
Theorem 1.6) as also given. 

The next statement, which can be seen as a variant of Theorem 1.6, allows us to say that 
also from a noncompact balanced sequence (uy),en We can always extract a concentrating 
sequence, even if we do not know if (uy) ncn is a PS sequence. 


LEMMA 1.1. Let (Un)nen be a noncompact bounded balanced sequence in jak (92). Then 
from (un)neN we can extract a concentrating subsequence in Hy. 


PROOF. Under a null extension of u,, to the whole of R", we can use the structure theorem 
for bounded sequences Theorem 1.5. Then we shall show that for every i > 1, |g;| solves 
(EI) with A = 0. Indeed, @y? lun | — |g;| and |u,| solves (EI). If we denote by v, the 
modulus of (py we have v, — 0. By scaling |u,,|, we have 


i\—l i\—1 * N+2)/2 
—A(oi) lial'< (oh) nl? Ho, OPA, (1.8) 
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which, passing to the weak limit, gives (EI) for v = |g;| and A = 0. This implies, in partic- 
ular, that ||@; || > SN/4 where S is the Sobolev constant, see Remark 1.10, so we have an 
estimate on the number of the limits g;, i > 1. Finally, we can show that (1.7) holds as in 
the proof of Theorem 1.6. 


REMARK 1.7. A more detailed argument, see [19], Lemma 6.2, shows that, while 
go solves (CP) on £2, every g; for i > 1, is a solution to (CP) on the whole domain for 
A = 0 multiplied by the number 


= lim ge) Se 
n 


From now on we shall denote by ot the modulus of the scaling Os so that for every 
given i we have a! > +00 asn > +00. 

For every i, j, through a selection argument, we can suppose that, for every n € N, 
a} < oj (or vice versa), then we can order the indexes in such a way that, for every n € N, 
it results o} < 0 Keg a . Therefore, with such an ordering, we have that po} cor- 


responds to a function concentrating in x in the slowest way. For every n € N, we set 
1 
a 

To the aim of establishing some local uniform estimates around the concentration points, 
we perform the following construction. In view of making estimates at a distance of the 


Co and x, =x 


order of o, I! 2 from the concentration point x,, we need to exclude that, for a suitable con- 
stant c, someone of the functions g;, for i > 1, could have a concentration point pad closer 
to 0B. ,—! /2(X,) than oy! 4 (let us recall that x, corresponds to the function concentrating 
in the slowest way), thus we argue as follows. For any n € N, let us consider k concentric 
annuli of width Tact ? and centered in Xn. Since, by Theorem 1.6, the total number of 
global solutions g; is k, we are sure that among those annuli there is at least one without 
any concentration point x Let Ae be that annulus. Since k < MS~/? does not depend 
by n, this procedure allows, passing to a subsequence, to choose a constant C, which 
does not depend on n, such that 1 < C <7k+1<7MS~—N/? + 1, and such that AD = 
Beppo "2 An) \ Ba,-1/2n)- Then we set Al = BE 160, "2 n) \ Bex yor? On), 
AZ = BG45)9242 An) \ Be snore Gn), AB = BGpajqr'2 An) \ Be aoc 2 Gn), get- 


1/2 1/2 ang go 


ting in this way four sequences of annuli, of width 7o, ’~, 50, '~, 3oy 
respectively, such that, for i = 1, 2,3, © ge is the ont! * neighborhood of AL. So when 
i increases Ae gets thinner and we are going to establish finer estimates on it. When i = 0 
we only know that A° does not contain concentration points x!,, we shall see in Section 2 
how this rough estimate improves, in the case of a balanced sequence, for i = 1,2, 3. When 
we shall deal with a balanced sequence (u;,),en, we shall assume to have fixed a constant c 
as above and so we shall consider the four sequences AL as also given and we shall call 


such sets safe regions of (Un)neNn- 
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1.3.2. Broken sequences. We pass now to the analogous analysis for problem (P). Let 
us begin by considering some inequalities, related to (P), that will be useful in producing 
estimates on the solutions to the approximating problems: 


—Auta(x)u<u?! inR, 
u>0 in RY, (EI) ) 
ue H'(R4), 


—Autdgu <u? inRY, 
u>o in RY, (Eloo) 
ue H'(RY). 


We remark that if u is weak solution of 


—Au+a(x)u=|ul?-2u in Q, 
1 (Pa) 
u€ Hy (8), 

2 CRN, then |u|, extended by 0 out of $2, is a weak solution of (EI,). 
According to the previous definitions, we shall say that (uy,)nen is a balanced sequence 

if, for every n, uy is a nontrivial weak solution to (AP,.,), where (Tp )neNs Mn € Rt, is any 

sequence so that r, > 0 and that it is a controlled sequence if, for each n, uy is a nontrivial 

weak solution to (EI,). Once again we remark that to any balanced sequence (uy)nen 


there corresponds a controlled sequence (v,)nen, Where vy, = |u,| in B,, (0) and v, = 0 
in RY \ B,, (0). 


REMARK 1.8. We see that, given any balanced sequence (u,)neNn and a sequence of trans- 
lation vectors (t))neN, tn € RY, lt2| —> +oo, if 
n—>+00 


u(-)= lim un(-—t) ae.in RY, 
n—-+00 


then |u| is a weak solution of (EI,9). 


A basic tool to face problems in unbounded domains has been the analysis of the 
PS sequences behavior and the information that in the framework of Theorem 1.5, 
when (1.3) is satisfied, a noncompact PS sequence differs from its weak limit by one or 
more sequences that, after suitable translations, go to a solution of (Poo) (see [7] and [4]). 

Here, since our aim relies in finding solutions to (P) that are limit of balanced sequences, 
we need to know how a noncompact bounded balanced sequence can look like. Moreover, 
since we want to analyze a rather general case by working with (a2) instead than (1.3), we 
cannot state the existence of a limit equation corresponding to (P). Nevertheless, by virtue 
of the previous considerations about the behavior of the balanced sequences and taking 
into account Remark 1.8, it is easy to realize that in our case the role of the limit problem 
can be played by (EI,,). The following lemma gives the necessary information leading to 
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the conclusion that the set of norms of the solutions to (EI,,) is bounded from below by a 
positive constant. 


LEMMA 1.2. There exists a positive constant Co > 0 such that for any nontrivial solution 
g to (Elo) 


lll p > Co (19) 
holds. 
PROOF. Let g be a nontrivial solution to (Ely), then ¢ satisfies 

IVells + acollglls < Ilgllp. 


By using Sobolev embedding theorem and by interpolating the L? norm (taking into ac- 
count that 2 < p < 2*) we have 


1-— 
Sllgll3« + dool@l3 < Illlp < (lp ISsllglls*)”, 


where S denotes the best Sobolev constant and a € (0, 1) is such that a/2* + (1 — a@)/2= 
1/p. By applying Young inequality, we get 
lol3-llglly * < ellgllax + A — @)Ilelle 
241/2 
< ki[(VSllgllo + Vasollglla) }” 


1/2 
< k2'/?(Sllgll}e + acoll@ll3) 
where kj is chosen so that k; > max(a/¥/S, (1 — @)/./doo ). Hence, 


p/2-1 1 


(Sllelias + doollella)”"” > pp 


and so we deduce, as desired, ||¢||) 2 Co > 0, where Co is a constant not depending 
on @. 


Taking advantage of Lemma 1.2 and by using the previous arguments, we can state the 
following assertions as corollaries of Theorem 1.5. Such results provide the desired picture 
of the controlled and therefore of the balanced sequences behavior. 


PROPOSITION 1.1. Let a(x) satisfy (a1) and (a2). Let (Un)nen be a noncompact controlled 
sequence bounded in H'(R%). Then, there exists a subsequence (still denoted by uy) for 
which the following holds: there exist an integer k > 0, nontrivial solutions to (Eloo) 9, 
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1 <i <k, sequences (ti \nen, 1 <i <k, such that 


k 
- gil. —1}) > in L?(RY), 
(1.10) 


Now we are going to apply the same idea, used in dealing with the concentrating se- 
quences, to the present case of diverging sequences. Specifically, we shall proceed in or- 
dering the sequence of translation vectors and in constructing suitable regions on which 
we shall establish local uniform estimates. Thus, given any broken sequence (Uy )neN, We 
assume as given also the functions g; and the translation vectors i (even if they are not 
uniquely determined) that appear in (1.10). Through a selection argument, we can suppose 
that, for every n € N, |r‘ | < |t/| (or vice versa), then we can order the indexes in such a 
way that, for every n €N, it results If) < || Kees eae For every n € N, we set t, = i 
the basic sequence of translations. In view of constructing the safe regions of the space to 
associate to any broken sequence, we introduce the following terminology. 


DEFINITION 1.5. Let AC R™ bea subset of R™ and v € RN a point v ¢ A. We call cone 
of vertex v generated by A the smallest set containing A and positively homogeneous with 
respect to the vertex v, i.e., the set 


{weRY |w=v+AQ—v),xEA,AER*}. 


Let (Un)nen be a broken sequence and let (t,)nen be the above defined sequence. In 
view of making estimates involving diverging sequences, we shall work in the safe regions 
connected with the basic sequence of translations in which we can deduce some a priori 
estimates which are not affected by the presence of other masses which are escaping to 
infinity. This time we shall not be concerned with annuli (so set differences of concentric 
balls) centered in x, but with set differences of coaxial cones with the axis parallel to t,. 
In order to avoid the other masses, we have to perform a similar argument to the one used 
for (CP). To this aim we proceed in constructing the following sequences of subsets of RY 
related to (t,)nen- For any n €N, let us consider the cone C,, with vertex t,, /2 and generated 
by a ball Br, (t,). We begin by taking the cone C;,, generated by the ball By, = B,,, (tn), 
where 


It ae 
Yi witho Ll 
aa Sc <9 <min( =. wan): cen) 


c being the constant appearing in (a4). If 0Ci.n 9 B,, /2(t)) = @ for all ti Ath, 1<ic<k, 
we set Cy = C1,, and Ry, =p, otherwise we consider the oe cone C2,, having vertex 
t,/2 and generated by Bo,,, (tn). Since Ital < |r! |, | <i <k, for any index i for which 
dCi nO B,, /2(t,) FY, we have Bry/2tn ) C Con, and we sat Cn = C2,n if 0C2,, does not 
touch any of the other balls B,.,/2(t),), t, 4 t1. Otherwise we pass to the cone C3, having 


an 
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vertex t,/2, generated by B3,, (t,) that surely contains the balls, of radius rp /2 centered at 
the points ¢/, touching 0C2,y. 


We iterate this procedure and, since the number of the functions g; is k, we are sure 
that after at most k steps, we can associate to f, a cone C,, having vertex t,/2, generated 


by a ball Br, (t), with ¥ lial =n < Ry <kry = pel having the property that dC, N 
B,,,/2(t},) = @, for any index i, 1 <i <k, such that tf) ¢ th. 


REMARK 1.9. Let 6, denote the width angle of the cone C,. We emphasize that, since 
R,= lel tan 6,, then 


y 1 1 
0< — <tané, <y <min{ —, —_—— ]. 
5° 4(¢+1) 


Now we introduce some tools which will be useful in dealing with problem (P). Let 
s € Randneé€N, we consider the cones 


Cu = Cy = Ste (1.12) 
and the regions around the boundary of C;, 
S25. — Cs.n \ C_s.n- (1.13) 


Lastly we set 


k 
S, = RN / U B,, /2(t}). (1.14) 
i=0 


1.4. Natural constraint 


The existence and the multiplicity results related to problems (CP) and (P) will be achieved 
by working with variational methods on the so-called natural constraint manifold, which is 
a subset V of Hy which contains all the critical points of a functional J and such that every 
constrained critical point of J on V is a critical point with respect to the whole space. We 
shall introduce this concept for the case of (CP), the other case is analogous. 


Let 
1 x 1 
ra) =5 | IvuP— 5 | wP-— f ul? (1.15) 
2JQ 2 J2 PJaQ 


be the functional corresponding to (SP). We introduce the natural constraint V for the 
functional J as the manifold defined by 


V={ul|u40, VI(u)-u=0}. (1.16) 
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Then the defining equation for the natural constraint is 


ow)= | vu — 2 f we f |u|? =0. (1.17) 
2 2 2 


PROPOSITION 1.2. For every u € VY, the following properties hold true: 
G) Iu) > 0; 
Gi) Iu) >c>O0,ifrA<A1; 
(iii) Tu) > WN, if} =0 and p = 2*, where S is the Sobolev constant. 


PROOF. By (1.17), a simple computation gives that, for every u € V, 


1w=(5-=)(f Ivara f wP)=(5-=) f jul? >0O. (1.18) 
p 2 2 2 p/Ja 


So by (1.18), (i) follows. If A < Aj, then 


Ivar — 2 f |ul? > cllullsjico) > cllull? 
i Q H'(2) Pp 
and hence, by (1.17), 
lel, <cllullp. (1.19) 


from which we have by the Sobolev embedding ||u||» > c. Finally, by combining this last 
inequality with (1.18) we have 


hepa ==) bese 
2 p/ Ja 


and so we get (ii). Moreover, when 4 = 0 and p = 2*, u € V implies |Vull5 = aes 
therefore, by the Sobolev inequality, we have S < ||u||5. 7 and so |lu||5. > S?-/°-2) = 
SN/? Then, by (1.18), we finally get 


1 1 me 1 wy 
I(u)= (5- x) ZS w> / 


from which (iii) follows. 


REMARK 1.10. The proof of (iii) also applies to positive solutions to (ED) when A < 0, 
since we only use the inequality || Vu Ie <|lu ee trivially implied by (ED). 


The main property of V is stated in the following proposition. 


PROPOSITION 1.3. Let (Un)nen C V be a constrained PS sequence for I). Then (Un)nen 
is a PS sequence for I}. 
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PROOF. Passing to a subsequence we can assume J (u,) > c > 0. If c = 0, by (1.18) 
we get ||ul|» > 0, so ||u||2 > 0 by Holder inequality and finally ||u||,71 = (lull, + 


Allull5) — 0 by the constraint equation (1.17). So uy, — O and therefore (un)nen is a PS 
sequence. Thus let us assume c > 0. For every n € N, we have 


VIUn) = UnVP Un) + Tn, 


where r,, is an infinitesimal term in H~!(2) and [Ln is the Lagrange multiplier. Then, for 
every n EN, 


VI (un) = Un(V7T (un) «Un + VI (un)) + In (1.20) 


After an easy computation, multiplying both the sides of (1.20) by uy and integrating, we 
get from (1.20) 


a-un [ Ivan? —2 f inl? = f inl”) 
Q Q 2Q 
=1n{ f [Vinal —2 f luni? (=D f tl?) + fet 
Q Q Q Q 


and, by taking into account the constraint equation (1.17), we have 


(P= 2)tn f inl? = tn 
2 2 


Now, by estimating the term on the right-hand side of the previous equation and by (1.17), 
we obtain 


/ n= tn < [rnllg-icqllenll cay 
Q 


2) 1/2 
< [rll yt ¢9) (Ilan ll + Allen ll3)/, 


where c is a positive constant. So by Holder inequality, 


—p/2 {= 
(p —2)pn <cllrall z—1¢9y (Ileal + llunllp ”).- 


Since |[rn||q-1(q) > 9 and Ilun Il > Pc > 0, by virtue of (1.18) and the condition 


p- 
c > 0, we get lyn > Oasn > ~. 


COROLLARY 1.7. Let u € V be a constrained critical point for I. Then u is critical point 
for I. 
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1.5. Existence of a nontrivial solution for the problem at critical growth 


In this subsection we shall only sketch the main arguments involved in the existence theory 
in the case N > 4 and d < Ay, we refer to [46] and the references therein for a more detailed 
treatment of the subject. On the other hand, the existence result is trivially implied by the 
multiplicity theorem which we are going to prove in Section 4 and which does not make 
use of this existence result. The only reason for which we are giving this sketch is to show 
the difference between a compactness argument based on a level estimate, which is enough 
to give the existence of a nontrivial solution and the compactness techniques required for 
the multiplicity results. 

We recall that for 4 < 41, since zero is an isolated point for V, we also have infy 1, > 0. 
To prove the existence of a nontrivial solution to the minimization problem for J, we shall 
assume to work with any minimizing sequence on Y and then, by applying the results of 
Section 1.3 and after some estimates, we shall conclude that along any of such a sequence 
the functional cannot reach a level corresponding to a noncompact PS sequence and so, by 
recovering compactness, the standard variational methods allow to state the existence of a 
solution. 


COROLLARY 1.8. Let (Un)nen be a noncompact PS sequence for I,. Then I,(un) > 
c>N7'!SN/ asn— oo. 


PROOF. Let (Uy)ncn be a noncompact PS sequence, by Theorem 1.6 we know that u, > 
go + ye. 1 Vi, Where ¢o solves the differential equation in (CP) on £2 and the functions ¢;, 
i=1,...,k, are concentrated solutions on R% with A = 0. Then 


k 
(un) > 1(go) + > loi) 


i=1 


as n — oo and can easily estimate the terms in which the functional is split in the limit. 
Indeed, by virtue of Proposition 1.2(iii), we have that for every i > 1, 


Io(gi) > N7'SN”?, 


So we can conclude that 1 lo@) > N—'!SN/?_ Since I,(@o) > 0, we have the 
thesis. 


At this stage to conclude the argument regarding the existence of a nontrivial solu- 
tion to (CP) we only have to show that really infy J, < N~'S/?. To this aim we set 
N > 4 and we consider the family of Talenti functions ug, that is, ug (x) = a N-2D/2y (6x), 
where u(x) = (N(N — 2))(N-2)/4 (1 + |x|2)A-N)/2, We may assume that 0 € 2 and we 
can choose 7 € Cj°(S2) be a fixed cut-off function such that 7 = 1 in a neighborhood 
Br(O) of 0. We set u% = nu,. After some computations based on the fact that u, op- 
timize the Sobolev embedding and so Jp(u,) = N7!S%/2, we get that, for o > 0 large 
enough, supyer 1, (au*) < N~!S/?. Indeed, the negative contribution due to the subcrit- 
ical term —A J glu |* turns out to be less infinitesimal than the positive variation of Jp (nua) 
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with respect to Ipn(uo) = N —l5N/2° due to the presence of the cut-off function 7, when 
o is sufficiently large. So we can find w € R such that au* € V and therefore we have 
infy I, < N~!S%/? and infy 1, > 0 if A < A,. Consequently we get the existence of a 
nontrivial solution to (CP). 


1.6. Existence of a nontrivial solution for the problem on the whole domain 


Also in this case we shall only give a brief sketch of the proof in a particular case, with the 
same motivations as in the previous part. 
Let 


1 1 
ra) =5 f (|Vul* + a(x)u?) dx — ~ | |u|? dx 
2 JRN P JIRN 


be the functional associated to the problem (P). Let us assume that limj,). +40 a(x) = 
Ago > 0, A(X) < Ago for every x € IR and let us consider the corresponding functional at 
infinity 


1 1 
to) = 5 f (ul? + dou?) dr ~ = f |u|? dx 
2 JRN P IRN 
which is associated to problem 
—Autdoou=|ul?-2u in RY. (Poo) 


We introduce the natural constraints V and Vo related to J and Joo, respectively. By argu- 
ing as in the previous case, since u = 0 is an isolated point for V, we begin by observing 
that 


I(uy>O Wuey. 


We set Coo = infyey,, [oo(u). AS we have previously observed, in this case the failure of 
compactness for a PS sequence can be controlled by scalings diverging by translation 
and, in order to get the existence result, we have to exclude this case for a constrained 
minimizing sequence on Y. Thus, let (uy)neN be a noncompact PS sequence for J; by 
Theorem 1.6, we know that J(u,) > I(go) + yy I59(@;), Where gp solves the differ- 
ential equation in (P), and the functions g;, i = 1,...,k, are solutions to (Poo) and the 
sequences of scalings pi, (g;) are diverging by translation. So, for such a sequence we have 
I(un) > C > Coo and this shows that compactness is achieved for energy levels strictly 
lower than Coo. Therefore, to get the existence of a nontrivial solution to (P), it remains to 
show that infy I (uw) < Coo. To this aim let ugg be a ground state solution to (Poo), fixa eR 
such that aug € V. Then we have Ig9 (Uo) = MAXyeR Io0(AUo9) and so 


I (Qugg) < Ig9 (Uo) < p99 (Ugo) = Coo, 


from which the condition infy J(u) < Coo follows. 
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2. Approximating problems and compactness of balanced sequences 


This section is devoted to the proof of the two compactness theorems (Theorems 
1.1 and 1.3), which are the most relevant step for proving the multiplicity of solutions 
(the variational approach through approximating problems discussed in Section 4 presents 
some difficulties but uses more standard ideas). We shall make use here of some estimates 
on the solutions which we shall justify roughly, by explaining why we can expect them, but 
which will be rigorously proved in the next section, which must be therefore considered as 
an essential part of the present one and which will make the proofs complete. Nevertheless, 
we prefer to develop the estimates in a separate section at the end, letting the reader already 
know how they should be and should be used. Let us begin by pointing out that no similar 
compactness result holds for PS sequences, as stated in the following easy remark. 


REMARK 2.1. Problems (CP) and (P) admit noncompact PS sequences. 
PROOF. For (CP) we just have to consider the cut-off Talenti function nu, considered in 


the end of Section 1.5 by letting o = 0, — +00. For (P), when a has limit doo at infinity, 
we just have to fix a solution uw to (Poo) and take uy (x) = u(x + t,) with |t,| > +00. 


The impossibility of proving complete compactness results for PS sequences is the rea- 
son for which we are working with balanced sequences. The elements of a PS sequence 
are close to be solutions of the problem while the elements of a balanced sequence are real 
solutions of a close problem and this makes a big difference: when we deal with the terms 
of a balanced sequence, we know that we cannot have even a small improvement of some 
functional of the same type under any local modification of the same order. 

On the other hand, when some masses are concentrating or escaping to infinity, we shall 
be able to produce a local modification which improves the value of the functional by 
respectively perturbing the concentration parameter or the translation vector. From this 
contradiction we shall be able to deduce the compactness theorems. The variation of the 
functional under such a local modification will be evaluated by a local Pohozaev inequality 
and the a priori decay estimates on the terms of a balanced sequence which will be found 
in the next subsection, carried in such inequalities, will formally produce the contradiction. 


2.1. Avoiding concentration 


In this subsection, we shall test the presence of concentrations which would prevent us to 
find solutions to (CP) as limits of a balanced concentrating sequence. To this aim, we shall 
evaluate the infinitesimal variation of the functional corresponding to (SP) under a scaling 
of a concentrated part of u,. Such a variation must be null because we are dealing with a 
balanced sequence. 


2.1.1. Local Pohozaev identity. The property that the variation of the functional under 
a scaling operation is null or reduced to a boundary term is equivalent to the well-known 
Pohozaev identity [37] which we must establish in a local form (namely without using 


542 S. Solimini 
boundary conditions) since it shall be tested on a small concentrated part of the func- 


tions u,. We fix a general open smooth set B in IR and shall consider, more in general, 
a semilinear elliptic equation of the form 


—Au= glu). (2.1) 


LEMMA 2.1. Let u be a smooth solution to (2.1) on a smooth domain B and let G(u) be 
a primitive of the function g(u). Then the following equation holds true 


vf (Gu + Sewn) --| (514200) ~ Gunex i) 
B 2* OB 2 
S N S 
+f (Vu -xncvu y+ > f (Vu-n)u. (2.2) 
aB 2* Jos 


PROOF. Multiplying by u and integrating by parts, we get 


[ivur= fo ewus f (Vu -n)u, (2.3) 
B B 0B 


where 7 is the outward normal to 0B. Multiplying (2.1) for Vu - x, since 
Vv: ((Vu -x)Vu) = Au(Vu-x)+ (V(Vu F x)) Vu, 


using the divergence theorem and by integrating by parts, we get 


/ —Au(Vu-x) 
B 


=— (Wu-xy(Vu-ii) + f Yu-(Vu-x +1 -Vu) 
dB B 


--| (Wu-xy(Vu-it)+ [ v(zivur)-x+ f |Vul- 
aB B \2 B 


5 1 5 ca | aN 2 
=— (Vu-x)(Vu-n) += [Vul“(x -n) + —— |] |Vul°. (2.4) 
aB 2 Ja 2 JB 


On the other side, integrating by parts we get 


[swou-n= vow) -x= f Gans) —N | Gu. (2.5) 
B B dB B 


Combining (2.18) with (2.5) we obtain 


=f Ivar =n | cw - f G(u)(x - 71) 
2* JB B aB 


-{ (Wu-xyvuiiy +5 f |Vul-(x +7). (2.6) 
aB 2 Ja 
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Finally, multiplying (2.3) for —N/2* and summing (2.6), we have (2.2). 


In the present case (i.e., g(u) = |u|?~2u + Au), (2.2) becomes 


(SZ) fess fe 
p 2*/) Sz B 
1 af st 5 
=f rary + > f | cv-ii+ f iPOD 
P Jas 2 Jas aB 


1 2 Ss N - 
-5/ [Vu G+ ef (Vu-n)u. (2.7) 
2 Jos 2* Jas 


By a translation, we can move the origin to any fixed point x9 € R and we can for- 
get, being p < 2*, the positive term (4 a x) 4 pz |4l|?, in order to obtain the following 
“Pohozaev-type” inequality 


1 aa. oo . 
af wie <— f ial? (x = 0)) +5 f |u| ((x — xo) - 7) 
B P Jas 2 Jos 
+ (Vu - (x — x0))(Vu -n) 
dB 


->/ IVuP((x a0) -) +> f (Vu-n)u, (2.8) 
2 OB 2* oB 


which we shall apply to the terms u, of a balanced sequence, which enjoys (2.8) for 
P= Pn, On a Suitable ball B = B,. 


2.1.2. Decay tools. The choice of the set B, in (2.8) is a crucial point in order to produce 
the contradiction. We shall take as B, a ball around the concentration point x, trying to let 
B,, contain most of the concentrating mass, making the left-hand side of (2.8) consistent. 
On the other hand, we must force the right-hand side to be small and, to this aim, we have 
to take into account two opposite indications: (a) B, must have a suitably small radius in 
order to keep the measure of the integration domain 0B, small; (b) B, must have a suitably 
large radius to keep the points of 0B, far away from the concentration in order to make the 
term u and Vu which appear in the integrals small. In order to guess a convenient choice 
of the radius, we can focus on the simple case in which the number k which appears in 
Definition 1.2 is 1, uw, = go + p} (gi) exactly and g is a Talenti function (defined at the 
end of Section 1.5). Since gp is a smooth function, we easily find the bound 


ee (N-2)/N 
Wn EN, Vx € 22: < 1+ | ——— e 2.9 
" ‘i Jen(x)| e( (seer) ) a 


So the values of |u,| are of the order of 1 when |x — x,| reaches the order of o, ? In 
such points we also have the bound 


Wn EN, Wx € 2: |un(x)| < con’. (2.10) 
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So a natural choice is to take on, /? as the radius of B,, and to bring (2.9) and (2.10) into 
the right-hand side of (2.8). In the general situation we must take care of several singulari- 
ties corresponding to unknown functions ¢g; and of the difference u, — ae pi, (g;) which 
is infinitesimal only in H!. So we shall work on the safe regions ae which are annuli at 
a distance of the order of o, |! ? from the less concentrated mass and avoid the other con- 
centrations. In the next subsection we shall prove the following lemma which essentially 
gives (2.9) in the most general setting. 


PROPOSITION 2.1. Let (Un)nen be a controlled concentrating sequence. Then there exists 
a constant C > 0 such that for any n € N and for any x € We. 


Un(x) <C. 
Passing to the smaller annulus AB we can also give (2.10) in an integral form. 


PROPOSITION 2.2. Let (Un)nen be a controlled concentrating sequence. Then there exists 
a constant C > 0 such that for anyn EN, 


i; Vin? < Cope NY? (2.11) 
A3 


n 


A simple mean value argument allows us to deduce the following corollary which 
gives (2.10) in a boundary integral form. 


COROLLARY 2.1. Let (Un)nen be a controlled concentrating sequence. For any n € N 


there exists ty €[C +2, C +3] such that, denoting by By the set B(xn, tnOp !”), 


d. iu Sear Me, (2.12) 
OBn 


where C is the constant in the above proposition. 


REMARK 2.2. The ball B, appearing in the previous corollary is not yet, in general, the 
set on which (2.8) is going to be tested. Indeed, we are not sure that B, C 92. This inclusion 
is not relevant as far as we work with a controlled sequence, whose terms can be assumed 
defined on the whole of RY , but must be forced if we want to deal with a balanced sequence 
in view of applying the Pohozaev inequality (2.8). 


2.1.3. Proof of Theorem 1.1. In this subsection we shall use the local Pohozaev identity 
to prove that concentrations are not possible for balanced sequences in dimension N > 7. 


LEMMA 2.2. If N >7 no concentrating sequence can be balanced. 


PROOF. Let a concentrating sequence (Un)neN be given and assume by contradiction that 
it is balanced. Let us fix n € N, we shall use (2.8) on By, = B(xy, tnoy 7) M 2, where 
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t, is the same as in Corollary 2.1, and we shall split 0B, = 0; By, U 0¢By, where 0¢ By 
(empty in the case in which the concentration point x, of the basic rescaled function @ is 
sufficiently far from 092) is 029 B,. When 2.B, = 9, to the aim of applying (2.8), we 
shall take xo equal to the concentration point x,. Otherwise we shall take xo out of 2 such 
that d(xo, Xn) <2tnon /” and 


Vx €deBn: n+ (x —x0) <0, (2.13) 


where 7 is the outward normal to 0B, (roughly speaking xo is the “symmetric” of x, 
with respect to 0§2). We want to show that (2.8) cannot hold true, in contradiction to the 
assumption that the sequence is balanced. To this aim, we give a lower bound to the left- 
hand side of (2.8) and a smaller upper bound to the right-hand side. For the first one, we 
shall restrict the integral on the ball BY = B(x, 0,7 !), which is contained in @ for n large. 
Then we have 


i, “= a (01) "(un))? > const, 
B(xXn.On ) B(xn,1) 


since, by Remark 1.4, (> ua — g; #0 and x, is bounded in RY, we see that the 
left-hand side of (2.8) has a lower bound of the form Ca.*: for a suitable constant C. 
Passing to the right-hand side, we firstly evaluate the possible contributions of 0.B,. On 
such a set only two of the integrals must be taken into account because we have u,, = 0 
on 0¢Bn C 02. For the same reason, Vu, has the direction of n and so the whole sum, 
from (2.13), can be written as 


1 2 
al |Vunl?(x — x0) i <0. 
2 Ja. By 


So we can focus our attention to the integrals extended to 0;B,. Hence from Proposi- 
tion 2.1, we get 


ie [itn |? ((x —xo)-ni) + ~{ lunl? ((x — x0) -t) 


a; Bn 


< cf ((x — x0) -f) <Co,™”, 
3; Bn 


and from Corollary 2.1 and our choice of By, 
(2—N)/2 


2 
/ |Vun|"|x — xo| < Con 
di Bn 


Finally, from both Proposition 2.1 and Corollary 2.1, by the Hélder inequality, 


1/2 1/2 
/ (Vn fun <{ f Yun) (/ inl) a6) es 
0; Bn 0; Bn di Bn 
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Combining these estimates, we see that the right-hand side of (2.8) is therefore bounded 


by Cog ** $0 (2.8) requires 


how? < CoP-/?, (2.14) 


n 


which when WN > 6, since o, — ov, is clearly false for n large. 


Theorem 1.1 is an immediate consequence (essentially a restating which does not use 
the terminology introduced in this chapter) of the above lemma. 


PROOF OF THEOREM 1.1. Let us suppose, by contradiction, that there exists a bounded 
balanced sequence (Uy)ycn such that 


sup sup |un(x)| =+o. 
neN xeEQQ 


A standard regularity argument [10] shows that u, cannot be compact in H!, so 
by Lemma 1.1 it has a balanced concentrating subsequence and this is excluded by 
Lemma 2.2. 


2.2. Avoiding escaping masses 


We shall now take into exam the case of a balanced sequence related to problem (P) and 
we shall assume by contradiction that the sequence is broken, according to Definition 1.3. 
This means, roughly speaking, that there are some masses g; which are escaping to infinity. 
So we are going to study the variation of the functional under a small translation of one of 
such masses which brings it back to the origin. 


2.2.1. Local Pohozaev identity for translations. The variation of the functional under the 
translation of a solution is evaluated by a Pohozaev-type formula. Since we only want to 
translate a part of the function, corresponding to one of the escaping masses, we must prove 
such a formula in a local version, namely without assuming boundary conditions, as stated 
in the next lemma. 

We fix a general open smooth set B in R™ and shall consider, more in general, a semi- 
linear elliptic equation of the form 


—Au= g(x, u). (2.15) 
LEMMA 2.3. Let u be a smooth solution to (2.15) on a smooth domain B and let G(x, s) 


be a primitive with respect to s of the function g(x,s). Then the following equation holds 
true 


-| Vy G(x, u)-f 
B 


=I (5174? - Ge.w)(v-7)- f (Vu-v)(Vu-f). (2.16) 
aB\2 aB 
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PROOF. We have 


i (—Au + g(x, u)u)(Vu-t) dx =0. (2.17) 
B 


Now integrating by parts, we obtain 


[/-au(vu-i)ax = | (Yu (Vu?) dx — (Vu. v)(Vu-7) do. 


B 


Then, taking into account that f does not depend on x, again using divergence theorem, 


we get 
[ (ru v(vu-i)) ax = ff (wu (Wu-7)) ax 
1 F 
=5 f (viver t) dx 
=5/ |Vul?(¢-v) do 
2 Jap 
and then 


/ —Au(Vu : ?) dx 
B 


=5/ ((VuP?(@-v)) dor — f (Vu -v)(Vu-f) do. (2.18) 
2 Ja aB 


Analogously we deduce 


/ Go.wy-t= | vo.w-t= [ yGo.w-7+ | geen. 
dB B B B 


So 
[ semvu-?= | Gowu-t= f VGo.u)-7. 
B dB B 

Therefore 


[ (IvuP Gv) — fu: »9(Vu-7) 


= Gowy-7 f V.G(x,u)-f. 
0B B 


1 
2 
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In the case of problem (P) we can take G(x, 5) = sisi? _ 4G) 52 


COROLLARY 2.2. Let a(x) satisfy (a1) and u be a solution to (P). Then the following 
identity 


1 


21 Pe fu (|Vul? +a(x)u *\(v- 7) 
2 JB 2 


1 
A v)( (Vu- 7) )-=f |u|? ( (v: 7) (2.19) 
P JaB 


where v is the outward normal to 0B, holds. 


2.2.2. Drift estimates tools. As for the case of (CP), we must now choose a convenient 
set B on which (1.10) leads to a contradiction. Again the contradiction will follow from the 
fact that the boundary integrals are too small with respect to the volume integral and this 
analysis is based on suitable decay estimates. Solutions to (P) have an exponential decay at 
infinity. One can guess that therefore we should find an uniform exponential decay on the 
terms of a balanced sequence of functions if we keep far away from the escaping masses. 
This means that the bound we are going to find is not of the type of e~%'*! but of e~?"), 
where the function o,, defined by 


On(x) = int |x— th], xeER, (2.20) 
QS 


will be called drift distance function and measures how much x is escaping from all the 
masses in which u, gets broken. Note that i? = 0 so on (x) < |x| for all n € N. Indeed in 
Section 3 we shall prove the following exponential decay result. 


PROPOSITION 2.3. Let a(x) satisfy (a,) and (a2). Let (Un)nen be a broken controlled 
sequence bounded in HRY). Then for any constant a € (0, ./doo ), there exists a constant 
Ca > 0 such that for n large enough, 


Un(X) <cge "Wx ER". (2.21) 


The above estimate suggests to apply (2.19), where u = uy is a term of a balanced 
sequence of functions, to a set B = D, whose boundary is far away from all the masses, 
as it happens with the cones C,, and the other regions introduced in the end of Section 1.3. 
We must take into account that u, solves the problem on B,,, so we have to take the trace 
of such cones on B,,. As in the case of the critical growth problem, the choice of B, will 
follow from a gradient estimate in an integral form. Indeed, in Section 3 we shall also prove 
the following estimate. 
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PROPOSITION 2.4. Let a(x) satisfy (a1) and (a2). Let (Un)nen be a broken controlled 


sequence bounded in H' (IR). Then there exist constants ot, > 0 and cy > 0 such that for 
allnéeN, 


[ |Vun|? dx <cye7 lal (2.22) 
S 


l,n 


where S| n is as defined in (1.13). 
Also in this case a mean value argument allows to pass to a boundary integral. 


PROPOSITION 2.5. Let a(x) and (un)nen be as in Proposition 2.3. Then there exist con- 
stants a* > 0, c* > 0 and a sequence (Sy)neN; Sn € (-5, 5) such that for alln EN, 


dh |Vun|2dx <cte7* lal (2.23) 
a ‘Sp Nn 


where, for all n, Cs, is as defined in (1.12). 
Then, it makes sense setting 
Di Cy BAO); 


where C denotes the cone C,, ,. We remark that, for large n, the vertex a € D,; indeed, 


even if On < |t,|, for all n, |t,| — Pn < C for some constant C, otherwise u,(-—t,) — O 
n—>+00 


contradicting the choice of t,. Moreover, we remark that 0D,, consists of an “internal part” 
(8Dn)i = Cn Bp, (0) 

and an “external” one 
(8Dn)e = Cn MABp, (0). 


We finally point out that by using (2.21) we easily get the following integral estimate, 
whose detailed proof is in Section 3. 


PROPOSITION 2.6. Let a(x) satisfy (a1) and (a2). Let (Un)nen be a broken controlled 


sequence bounded in H'(R%) and S, be as in (1.14). Then, for all p > 2, there exist 
constants a@ > 0 and ¢ > 0 such that for n large enough, 


[ (Up)? dx < Ge “tal, (2.24) 
Sn 
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2.2.3. Proof of Theorem 1.3. We are now ready to combine the local Pohozaev for- 
mula (2.19) with the exponential decay estimates in the previous propositions to the aim 
of proving Theorem 1.3. Let us begin with a lemma which is the only step in which we 


use (a4). 


LEMMA 2.4. Let a(x) satisfy (a1) and (a4). Let (Un)nen be a noncompact balanced se- 
quence. Then, for large n, the inequality 


i (Va(x) . in) Up dx > 1 / =u dx (2.25) 
D, oe D, Ox . 
holds. 


PROOF. Denoting by Ge the component of f, lying in the space orthogonal to x and 
containing x, using (a4) we get, for large n, 


(Vax) - in) = (Vax) -X) (in -X) + (Vea) (in) ,) 
00 i Oe eA 
> FEO 3) FFG), 
DS ep ee 


In order to evaluate [fn “xX)—¢| Ge |], let us first suppose x € Bor, (tn), So that |x —t,| < 
2Rn < Y\tn|, with y as in (1.11), then we have 


eo th t, —t tn| —|x —t th| —|x—t 1-y 
(i, - )-(4 = t)> MW |x nl In| |x nls is 
Itn| |x| |x| ltl +lx—-tfl~ 1+y 
(2.26) 
and since 
fis Xx. ty —x 
ele Vall 
> Iti —x| 
I(in).,1< a </. (2.27) 


On the other hand, we can assert that, by homothety, (2.26) and (2.27) are also true for 
all x belonging to the cone K having as vertex the origin and generated by Boa, (t,). Then, 
in particular, (2.26) and (2.27) are true for all x € Dy, ue bs S Cn Cc on 


Thus (2.25) follows because we have, by the choice of y, 


san 


a iD 


We can combine the previous lemma with Corollary 2.2 obtaining the following result. 
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LEMMA 2.5. Let a(x) and (un) nen be as in Lemma 2.4. Then the inequality 


1 da 
ri [ ae On () 
1 S 
< a (|Vun|? + a(x)uz) (Vn + tn) 
(ODn)i 
x 1 xy 
=f (tn vn) Fa) = — fal (On Fe) (2.28) 
(9D n)j P J(aDy); 


holds. 


PROOF. Combining (2.19) and (2.25) we obtain 
1 da 1 > 
if, sett <3 J, (Veal? + aconug) (mi) 


4 1 > 
a Vun * Vn Vun + th) — = ale n*'n)- 2.29 
[oo Un)(Vun « tn) - f lunl? (Un - tn) (2.29) 


aD 


Now, for all 1, u, solves (Pz,, (0))s Un =0 on JBy, (0) D (ADn)e, SO Vu and v, have 
the same direction, moreover, on (0D, )¢ it is (Vy - tn) > 0, thus we deduce 


/ a(x)uz (Vn - tn) =o= | unl? (Vn - fn) (2.30) 
(ODnde (IDn)e 
and 
al [Vuinl? (Vn : ii) _ / (Vuln - Un) (Vuln . in) 
2 J(aDn)e (8Dn)e 
1 Be, 5 Teg 
= >. |Vun| (vn 2 in) a (Vuln -OVun)| ~Vn * tn 
2 S(aDn)e (@Dn)e 0 
1 2 > 
=e Vv in) <0. 2.31 
2 se |Vun| (vn n) ( ) 


Hence (2.28) follows inserting (2.30) and (2.31) in (2.29). 


Taking the decay estimate in (2.28) we can finally deduce the compactness of a balanced 
sequence. 


LEMMA 2.6. Let a(x) satisfy (a1)—(a4) and (un) nen be a bounded balanced sequence. 
Then (un) nen is relatively compact. 


PROOF. We argue by contradiction and we assume that (uy )neNn is not compact. Then, by 
Proposition 1.1, up to a subsequence, it is broken in L? and, by Lemma 2.5, the inequal- 
ity (2.28) must be true. 
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Let us consider, for n large, the right-hand side of (2.28). First of all, let us observe that, 
by (a2), a(x) > 0 for all x € (0D); so, taking into account that (vy - ty) <0on (0D,);, we 
have 


i (|Vun|* +.a(x)uz) (Un tn) <0. (2.32) 
(8Dy)i 
Moreover, by using Proposition 2.5, we deduce 


-| (Vuy - Un) (Vun tn) do 
(8Dn)i 


<| [Vun|-do < te |Vun|2do < cte—® ml, (2.33) 
(8Dn)i aCn 


Let us now show that there exist constants a’ > 0 and c’ > 0, independent on n, so that 


-| lun? (Vn + tn) do <| lun|? da < cle ltl, (2.34) 
(@Dn)i (@Dn)i 


Since (0D,,); C aC, and, for large n, aC, C Sy, using Proposition 2.3 we infer 


- / lugl? do 
(Dn)i 
k ry 
< ie up|? do ae e MMP do < a he e Pl inldg, (2.35) 
aCn aCn ay voc 


a € (0, ./doo ), Cy > 0. 
Setting, for h > 1 andi =0,1,...,k, 


Ani = {x e0Cs a <|x—4)| < a (2.36) 


and denoting by |Aj,,;| the (NV — 1)-dimensional (Hausdorff) measure of Aj, ;, we have for 
PO) Lyk cks 


N-1 
[Anil < c|2"| , CER, (2.37) 


because it is not difficult to understand that, Vh, |Ay,;| can be estimated by the surface of 
the cylinder having height and basis diameter measure equal to eh 
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Thus, in view of (2.36) and (2.37), we deduce 


ee) 


i h-1 
ie e Pletal do < >| e eP2 rn/2 do 
Cn h=1 Ah,i 


2 h—1 r, ee 
20 De en tre a Ei =| (2.38) 
h=1 


hence, inserting (2.38) in (2.35), we obtain as desired, 
= h 
/ |un|? do < c) krN—le-aprn/2 ere gh(N—1) < cle” Itn| (2.39) 
(ODn)i h=0 
On the other hand, denoting by 6, = max{/n, |tn|} and by 
Dn = Cn Bp, (0), 


we have, for large n, 


is ax ( ) Zi a ( ) z ? in Ox ( ) [ 
d Za inf = Za in = 7 
: X)U, AX 4 XxX ; u, ax : Xx : uj, ax 


C > 0 constant, because, as remarked at the beginning of the section, (||t:| — On|)nen iS 
bounded from above. Moreover, in view of Proposition 1.1 and of the choice of tf, we infer 


(2.40) 


liminf i. uxdx >A>0, %=const. (2.41) 
n— +00 Dn 


Then, combining (2.28) with (2.32)—(2.34), (2.40) and (2.41), we obtain 


1 = * i ! ~ 
1 Sine( 24 (0) <ctene "lil 4 Sea ltnl < Gen Atl, 
4 D, \ Ox Dp 


a@ = min(a*, a’), and this is impossible by (a3). 


PROOF OF THEOREM 1.3. If the statement is not true, we can extract from U a balanced 
sequence which is not precompact and therefore, by Proposition 1.1, has a broken subse- 
quence. Then we get in contradiction to the previous lemma. 


3. Decay estimates 


This section completes the previous one by proving the estimates stated in Sections 
2.1.2 and 2.2.2. 
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3.1. Decay estimates near concentration points 


We start by considering a balanced sequence related to problem (CP) and establishing the 
estimates in Section 2.1.2. We recall that we can always substitute the terms u, with their 
absolute value, extended by 0 on all of R%, passing to the weaker assumption that the 
sequence is controlled but getting free from caring about the sign of the function or the 
shape of £2. 


3.1.1. Integral estimates for controlled concentrating sequences. So we shall work with 
a controlled concentrating sequence (uy, )nen. The boundedness of the sequence in H, ! and 
so in L?", cannot hold in L? for p > 2*, because of the presence of concentrations. On the 
other hand, such concentrations are small in L? for p < 2*, so that, modulo an infinitesimal 
term, u,, can be split in a part which keeps bounded in L? for large p and in a part which 
is infinitesimal in L? for small p. 

In order to guess what kind of estimate we are going to find, we can assume that uy, = 
go + pi (g1) exactly and that ¢g is a Talenti function, as in the beginning of Section 2.1.2. 
In such a case, yo € L? for every p, while g,; € L? only for p > 2*/2 = N/(N — 2). If 
p > 2*, then ||goll p; < const and if 2*/2 < p2 < 2*, then 


gin —N/p2 ae ee 


len()I_,, lilly = 


If one has several concentrating masses ¢;, then 
k k 
ei} <> loi @l,, 

i=l 


P2 i=1 


k 
iN/—N/ pay 
<)om on Pilly. 


< const - ae SNAPE 


(3.1) 
So we are lead to introduce the following definition. 


DEFINITION 3.1. Let pj, p2 €]2, +c0[ be real numbers such that p2 < 2* < pj, a >0 
and o > 0. We consider an inequalities system 


uillp, See, 
a (3.2) 


llMallp, <aoN/?—N/p2, 
which will let us introduce a norm depending on p1, p2 and o, by setting 


|p). p20 = inf{a > 0 | du1, u2 such that (3.2) is satisfied and |u| < uy + uz}. 


The above norm will be briefly denoted by ||u||, when p; and p2 can be supposed to be 
given. 
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REMARK 3.1. Let pj, p2 €]2,-+oo[ real numbers such that pz < 2* < p; and o > 0, 
then, by definition, for any function u, we get 


N/p2.—N/2* 
Nelle < Mella» Weel < Mtl po MPN, 
We can easily see from (3.1) that for every p;, p2 such that x < p2<2* < pi, 


k 
vo+ > pi (Gi) 


i=1 


< const. 


P1,P2,9n 


The main goal of this section is to show that the same bound holds for u,, which differs 
from go + yr pi, (g;) by an infinitesimal term in Hy which is not a priori even bounded 
in the norm || - || p;,p,0,- Thanks to the assumption that (Uy )nen is also controlled, we shall 
be able to prove the following Brezis—Kato-type regularity result (see [10], Theorem 2.3): 


PROPOSITION 3.1. Let (Un)nen be a controlled concentrating sequence, then for any 
* 

Pi; P2 els, +oo[, p2 < 2* < pj, there exists a constant C(p1, p2) depending on the 

sequence and on the exponents p, and p2, such that for anyné€ N, 


lun llon <C. 


To this aim, we shall state three preliminary lemmas: a continuity lemma, a bootstrap 
lemma and the relative initialization lemma. 


LEMMA 3.1. Let u and v € H'(R%) and a € LN/?(RY) be three positive functions such 
that 


—Au <a(x)v. 


Then for each p1, p2 €|2, +00l, there exists a constant C(N, pj, p2), depending on the 
dimension N and on the exponents p, and p2, such that for any o > 0, 


lu llo < CN, pi, p2d\lallyailulle. 


PROOF. Let u, v be as in the statement of the lemma and let fix o > 0 and e > 0. Let 
v < v1 + v2 such that v; and v2 satisfy (3.2) for a = |lv|l p;,p,0 + €. Let us consider, for 
i = 1,2, the solution u; € H!(R%) to —Au; = av;. Then 


i llp; < CN, pdllallnallvill p; 


and, being —Au, — Au2 = av; + av2 > av > —Au, by the maximum principle, we 
have u < uj + up. Since the functions u; satisfy (3.2) with a = C(N, pi, p2)llalln/2 x 
(llullo + €), with C(N, pi, p2) = max(C(N, pi), CCN, p2)), by the arbitrariness of ¢ we 
get the thesis. 


The bootstrap argument relies in the use of the following lemma. 
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LEMMA 3.2. Let pj, p2 € 14 axe such that po < 2* < p, and let qj be defined, for 


—2’ 2 N-2 
i= 1,2, by 


1 N+21 2: 
di N-2 pj N- 


(3.3) 


Tf u and v are two positive functions whose support is contained in a bounded set 922 and 
such that 


—Aus< yl +A, 


then there exists a constant C(N, Pp, p2, 82) such that for any o > 0, 


jee 


4 llqr.qr.o SCN, Pi, P2, 2)((Il¥ll p,p2.0 +1). (3.4) 


PROOF. By proceeding as in the previous lemma, we consider v = v; + v2 where the 
functions v; satisfy (3.2) for @ = |lullp,,p),0 + € and ¢ is a real strictly positive number 


arbitrarily small. Let uw; and wz be two functions in Hy (2) such that 


“ee ID END oo 


— Aug = 28D yNADUN-D), 


Since 


pNt2)/(N-2) 44 


Q(N+2)/(N-2)-1 ie aa 9(N+2)/(N—2)—1 a a 


+A+ 
= —Au, — Aud, 


by the maximum principle, u < u; + uz follows. Hence, we have to estimate ||u1|l¢q, 


and ||u2||¢,. We have, using (3.3) and being xt <Di< Nt 


(N+2)/(N—2) 
lille < CW, pr) ver" + Al er-nyjeren 


N+2)/(N—2 = 
< CN, Pr)(lvallp LN + AlN) 


) (N+2)/(N—2) 


< C(N, pi, 2)((IlUll p1,p,0 + € +1). 


Analogously, if we use the equality 


N N_(N WN N+2 
2* qo 


~ \2* pp J N-2’ 
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we get 


(N+2)/(N—2) 
lluallan < CCN, pr)(Ilvallp.) 9” 


( 
< C(N, P2)[ (lll p..p2,.0 Paha Nia ee) 
( 


N+2)/(N-2 *_ = 
= C(N, p2) lll p.p.o + 2)° d/( dg N/2 N/p2)(N+2)/(N—2) 


N+2)/(N-2 x 
=C(N, p2)(llvll p:,p,0 +8)! MC dg N/2 N/@2 


So wy and uz solve (3.2) for C = C(N, pi, p2, 2)((NlUllpy,p.,0 +E *?/N ™ + 1); this 
concludes the proof by the arbitrary choice of ¢. 


Now we need to initialize the exponents through the following lemma. 


LEMMA 3.3. Let (Un)nen be a controlled concentrating sequence then there exists a con- 
* 
stant C and exponents p1, p2 € | =, +oo[, p2 < 2* < pi, such that for anyn EN, 


Ilunllon <C. (3.5) 


PROOF. This proof will follow a Brezis—Kato-type argument (see [10]) in order to get free 
from an infinitesimal term which is the only real obstacle to our estimates, as explained 
in the beginning of this section. For any n € N, we can consider using a homogeneous 
notation, u, = u9 + u} +u2, where 

e ul stands for the weak limit go, 

e u> stands for the sum of rescaled functions g;, uz = eae pi (gi), 

e u? =Un — ur — @o is, by definition of concentrating sequence, an infinitesimal term 

in L?* norm. 

We shall overcome the difficulty due to the presence of ue by taking advantage of the 
assumption that we are dealing with a controlled concentrating sequence. Let u be one of 
the terms uy, uj = Tid and a; = max(1, 306-N)/(N—-2)yy, 4/(N—2) fori =1,2,3,ando =oy. 
The infinitesimal character of u° shall allow us to consider ao as small as we want in the 
LN/? norm ((3.5) is easily checked on a finite number of terms, see [10] and [25]). Being 


wis we < max(1, BONN) (yg [4/N-2 as wo + Peis 


we can consider u as a solution to —Au < (ap + a; + a2)u + A, so by the monotonicity 
of the Green operator G (G: H (Q)> He (2) denotes the inverse operator of —A) we 
have 


U<G(agu) + Glayu + A) + G(azu). (3.6) 


Since 92 is a bounded set and a; € L™, we get that G(a,u+ A) is bounded in W222" <> LPI 
for any p; such that 
1 1 2 N-6 
> = 
Pi 2* ~=6ON 2N 
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and so (see Remark 3.1) 
|G@iu+ A), <|Gaut A), <C. (3.7) 


Now let 2” < po < 2* be given. We consider the index r such that 


P2 “pe ON? 
from p2 > 2” we get r > x The decay speed of the solution g = g; (see [25]) allows us 
to say that a2 € L’ and, if we want to estimate the L’ norm of a2, we just have to take into 
account the less concentrated term, namely ,(@), as follows from r < x. which is in turn 
a consequence of p2 < 2*. By easy computations we have 

llazllzr < Co? NM, 
which, taking into account that 2— N/r = N/2* — N/p2, implies 

|Geaou)|| ,, < Cllazilar lulz < CoN N/P2, (3.8) 


therefore, from Remark 3.1, 


|Gianu)||, < ao N/p2-N/2* 


G(au)|,, <C. (3.9) 
Now we point out that with the above choice for p; and p2 we get 
1 
|GCaow) |, <5 llulle- (3.10) 
Indeed, by Lemma 3.1, we get 
1 
||Gaou) |, < Cllaollwallulle < 5 HH Ilo. (3.11) 


under a suitable choice of the bound on the norm of ao. So by (3.6), (3.10) and the triangular 
inequality, we finally obtain 


llullo <2] G(arw + A)|, +2|G(arw)| 


Oo 


which, combined with (3.7) and (3.9), gives the thesis. 


PROOF OF PROPOSITION 3.1. Let (Un)ncn be a controlled concentrating sequence. By 
applying the initialization Lemma 5.2, we can find a constant C > 0 and two exponents, 
Pi and p2 e]ee, XA p2 < 2* < pj, such that (3.5) holds. Using the bootstrap 


Lemma 3.2 we can repeatedly enlarge the interval ]p2, pil to ]g2, qil, where the expo- 
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nents q; are given by (3.3), obtaining (3.4). ae procedure allows us to manage, in a finite 
number of steps, every exponent p1, p2 ae =, +00. 


3.1.2. Local uniform bounds on controlled concentrating sequences. We are now go- 
ing to establish the local uniform bound on the terms of a controlled concentrating se- 
quence on the safe regions Ae stated in Proposition 2.1, whose proof is the main goal of 
this section. 

The proof is a simple variant of the argument used in [41] and in [25] and shall require 
some preliminary steps. We begin by establishing a weaker estimate. 


PROPOSITION 3.2. Let (Uj)ncn a controlled concentrating sequence. Then there exists a 
constant C > 0 such that, for any n € N and for any x € Ab 


unneCoe 


PROOF. We shall proceed by contradiction: let (y;)nen be a sequence such that yy € At 
for any n € N and 


2-N)/4 
Jo! y/ 


Da. Un(yn)O; =+o, (3.12) 


n>+ 


and let us scale the functions u, in such a way to carry the point y, in the origin and 
normalize the value of the functions. The required scaling sends uy in u, defined as 


Un(x) = pn! 2 an (PnX + Yn), 


where 


2/(2—N) 2*/N 


Pn = (un (yn)) = (itn (yn)) , 


so that u, (0) = 1. Note that, using (3.12), we have 


lim Pn 
n—>+0o Gale 


=0. (3.13) 
Therefore, since yy € Al. there is no concentration point which approximates y, at a dis- 
tance less than or equal to a; ie and so of the order of p,, we can deduce that u, ~ u =0. 
The contradiction will be archived by showing that we can choose the points y, in such a 
way to have u 4 0. This shall possibly force us to work ona (€0y Mh *) neighborhood of At. 
but this change will obviously not make any relevant difference in the above argument. The 
choice will consist in forcing the property 


lin(y) <2 (=2i,(0)) Vy € Bp(0), (3.14) 
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for some given p > 0. Then by using that iu, still satisfies (EI) and by estimating the 
variation of the mean value of u,, we have for0 <r < p, 


F 7 j 1 : 
a Un =iin(o) + | NbytN-! (/, Ain) dr 
>1 os i (27-14 A)dt=1 Crs 
sl a ght = a r = ~? 
og OP pe 2 


where by stands for the (N — 1)-dimensional measure of the unit sphere in R" , provided 
we choose r conveniently small. So the weak limit # cannot be zero. Therefore we only 
have to prove (3.14). To this aim, let us fix p > 0 and assume that, for a given n € N, 
yn does not satisfy (3.14). Then we must fire y, and look for a better point to hire for the 
same job. Since (3.14) is false, we can find z, € B,(0) such that 


iin (Zn) = par?" un (OnZn + Yn) 2 2. (3.15) 


The first candidate to replace y, is 


() _ 
n 


Yn = PnZn + Yn 


which leads us to replace py by 
pl) = [un GO ee < 22/2-N) 5. (3.16) 
We can be sure that yg? is at least as good as y, to let (3.12) hold since (3.15) implies that 
un (yy?) > 2un(Yn)- (3.17) 


Moreover, being Zn € By (0), we get 


|y — yn| = lznPnl < opn- (3.18) 


We can define u, as before by substituting y, and p, with yg? and ps), respectively. If 
this new u, satisfies (3.14) we do not have to look for other choices. Otherwise, we repeat 


the same argument and we choose a second candidate y by arguing in the same way. For 
any fixed n € N, we proceed recursively finding a sequence yf, yO, sendy y®, ... as far as 
we do not find a successful choice, which lets us claim (3.14). We can easily see that this 


process cannot go on indefinitely. Indeed (3.16) becomes in the general case, for i > 0, 


pry < QR) 4 ©) 


and (3.18), 


pg? — 9 | < onl? 
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Then one easily sees, by taking the sum of a geometric sequence, that yP converges to a 
point yo? as i — +00 but, by construction, we have uy, (y?) — +00, in contradiction to 


the smoothness of u,. Finally, for every i > 0, we have 


+00 

= ; —1/2 

y¥? — yn| < ppm S227/2-9)) < 20g 
j=0 


for n large. So all the points y? are in the (eo, |! *) neighborhood of Ad and so can be 
used to replace yy. 


PROPOSITION 3.3. Let (Un)nen be a controlled concentrating sequence, then there exists 


a constant C > 0 such that, for any n € N and for any r € [Coy ue (C +5)on ee) 


} Un <C. 
OB; (Xn) 


PROOF. By continuity, being (uy; )nen bounded in Lc L!, we can suppose 


/ Un <C 
By (xn) 


with a constant C independent from n. So, for any n € N, there exist rp € [5. 1], such that 


} Un =C. 
OBry (Xn) 
N+2 


We are going to use Proposition 3.1 for py = NA+ and pz = 7/5, SO, for any n € N, we 
choose uj = uy,, and uz = u2,, such that (3.2) is satisfied for o =o, and with a constant a 
that does not depend on n. Estimating the spherical mean variation from r, to r and taking 


into account that (C +5)on- 12 <1/2,ie.,r <r, forn large, we find 


r 4 mr | 
m=c+ f <f und =C+ | i Aun dt 
on i rm It a8) p NDR ay 


1 
1 P 
<C+ —— 2 AN at 
ess NbytN7! bes (" ) 


} 1 
4/(N—2) (N+2)/(N—2) 
<c+f 2H uv dt 
Bi (Xn) 


Con NbytN- 1 
, 4/(N—2) 1 4 NF2IN=2) A f} 
+ 2 ee ~~“ dt+— | tdt 
= NbntN— ! fo an a 
94/(N-2) a 
aie ene? Fare yee 


Nbn 2N 
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where, for i = 1, 2, 


: 1 

(N+2)/(N—2) 

ips i =e u' dt. 
Ga,2/" gv} Bi (xn) ie 


Being uy € LNW+2)/(N—-2) | by the Holder inequality, we get 


ae 
Ny\1-1/N (N-+2)/(N—2) 
Arse fre) Nanay de < CoC. 


On the other side, being v2, € LAN+2/(N—2) ie, es) € L! we have 
: 1 
(N/2*—N(N—2)/(N+2))](N+2)/(N—2) 
A2< ee cN=T [aon | dt 
: 1 
— _(N+2)/(N-2) . 2—N)/2 
=a On i aee pN-1 dt < CG 


and this concludes the proof. 


From Proposition 3.3 we see, by integrating with respect to r, that 


} ig SC. (3.19) 
A 


1 
n 


Since, Vx € A Bo-12 ey ce Al and the measure of the two sets are of the same order, 


from (3.19) we deduce that 


Vine AX } pC: (3.20) 
B-1/2() 


Since 


Un(x) = lim Un; 
p> 0 JB, (x) 


Proposition 2.1 follows from (3.20) if we estimate the variation of fe,(x) uy, forO< 


172 
PLO Ve 


PROOF OF PROPOSITION 2.1. Let us fix an index n € N and a point x € A If un(x) < 
2 Fr erie Un, by (3.20) we have done. Otherwise, setting for any p > 0, 


mip) = f Un and m(O)=un(x), 
Bp (x) 
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we deduce that 
2 —1/2 = 
dp < on such that m(p)< 5m(0) = sn (x). 


Then we take 1 and 2 € [0, p] such is m(p) attains its maximum in (1, and p2 is the 
least value of o > ¢; such that m(p) < 5m(p1). 

Being uy solution to (EI), and B,, Oc) G AX. we have on such a set, by Proposition 3.2, 
us! 2) < Coy. So we find, for n sufficiently large, 


1 Pi/d p2 1 
oT, Gl u )ar= = / Au do 
2 oo \4P JaB,(x) " po NbveX! Jp : 


(ui) 


un + A)dpe 
si Tin FIA Ia my ) 


< — =r (( sup u nea) 7) + Abyp) do 
xin By (x) Bp (x) 


ie ae / in+ Ao" ) a 
Bo(x) 

2 

<C(m(prdon +A) f 

p 


pdp < Cm(p1)on(03 — pt), 


1 


therefore (p5 = py) > Ca and so p2 — ~1 > Co, |!*. Denoting by A the annulus cen- 
tered in x of radii p,; and p2 we have that measure of A is of the order of o, ue e i.e., of 
the same order of Al and so as in (3.20) we have 


fimse. 
A 


On the other hand, 


1 
fun  meor) = 5m(or) 
A 


and so 


Un(x) =m(0) <m(p1) <C 


3.1.3. Gradient estimates. In this subsection we shall prove the integral bound for the 
derivatives of every term u, of a controlled concentrating sequence in its safe regions A 
stated in Proposition 2.2. One can easily guess that, since VA and Au, are uniformly 
bounded on AC and the width of Aa is of the order of Ga eae can be expected to 
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be of the order of on /? as stated in an integral form in (2.11). Such an estimate can be 
easily proved in a rigorous way by a Caccioppoli-type inequality. 


PROOF OF PROPOSITION 2.2. Let us fix n € N and consider gy, :R% — [0,1] a smooth 
positive mollifier radially symmetric around x, such that 

(1) Gn =1o0n AB, 

(2) Gn =0 out of A?, 


(3) Agn < Con. 
By (2) we have g, = 0 and Vg, = 0 on aA2, and so, integrating by parts, by (1) we get 


i: —AununGn = ie Vun On ai i Vun + V@nun 
R n nN 
> Vunl? + Vv rae -V@ 
me AB a A 20 ie 


1 
= Video Agnuz. 
I Un ar nu, 


Therefore, being u, solution to (EI), by Proposition 2.1 and (3), we have 


* 1 
i, Vin? < f (cae + Aunts AGntty <C(1+on)|A;|. 


n 


(3:21) 


Since o, > | for n large, one has (2.11). 


3.2. Decay estimates at drift points 


The purpose of this second part is to establish the decay estimates and integral bounds, 
concerning bounded controlled sequences contained in Propositions 2.3, 2.4 and 2.6. 


3.2.1. Uniform estimates. The first step is proving a lemma that allows to obtain an uni- 
form upper bound on the values of the Laplacian on a controlled sequence. 


LEMMA 3.4. Let a(x) satisfy (a,) and (a2). Let (Un)nen be a controlled sequence bounded 
in H'(R%). Then (un)nen is bounded in L® (RN). 


PROOF. By (a;) and (a2), there exist a constant a € (0,d9.) and a positive function 
c(x) € Co(R) such that a(x) > a — c(x) Vx € R™. Therefore un weakly solves 


—Aulyn + Gun < ue! +c(x)un inR’, 


Multiplicity techniques for problems without compactness 565 


moreover, by the maximum principle, for any weak positive solution v, € H!(RY) to 
—Avtavaur+c(x)un in RN, (3.22) 
the relation 
Un(x) <Un(x) in RN (3.23) 


holds. 

Now, let us consider a sequence (Uy,)neN, Un € H'(R"), such that for all n € N, 
Un Solves (3.22). By (3.23), the claim follows proving that (|Un|oo)nen is bounded. 

Since un € H'(R) and c(x) € Co(R), we can assume up! + c(x)un € LE), 


so by regularity results vy» € W~ pi oo Now, the space We embeds 
-1 


2 * * 
— 2 and, since ee ee = 26. 


(RN A Pp 
continuously in L7(R™), where = = 7] a = 


*/ 2* N p-l 
@ > ye =2*. Then, by (3.23), un € L4(R") with £ > 1, and 


lunlg <lalg < Aah) + c(x)un ne pt) <k2- 
By iterating the same argument, we gradually increase the regularity properties of 
Uy and vy, obtaining also uniform bounds to the norms in ie respective spaces. After a 
finite number of steps we obtain v, € W~ -4(R) with g q>> % and ln ll woe < k3, k3 not 
depending on n. 
Then the Sobolev embedding theorem gives v, € C°(R%) for some pu € (0, 1), and 
Il Un Ic0.u (RN) < kq. 
This last relation with the L? summability allows to obtain an L® uniform bound 
on (Vp)neNn and, in turn, on (uUy)neN as desired. 


COROLLARY 3.1. Let (Un)nen and a(x) be as in Lemma 2.3. Then there exists a constant 
c, > 0 such that for alln €N, the relation 


—Auyn < cy (3.24) 

weakly holds. 
The proof of Proposition 2.3 is carried out through some estimates, on bounded con- 
trolled sequences, proved in a slightly general setting. In order to do this we introduce the 


following definition. 


DEFINITION 3.2. Given a sequence of functions (Un)neN, Un € H' (RY), anda sequence 
(Xn)neNs Xn € RY’, we say that (xn)nen is a sequence of drift points for (Un)nen if 


Un(©—Xn) 0 weakly in H'(R). (3.25) 
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REMARK 3.2. If u, A 0, a sequence of points (%,)nen is a drift sequence if and only if 
On(Xn) > +00 and, since oy (Xn) < |x|, nr) nen iS unbounded. In general, o,(x;,) — +00 
is equivalent to (x,)nen being an unbounded drift sequence. 


The following lemma guarantees that the values that a controlled bounded sequence 
takes around the drift points x, of a sequence are small. 


LEMMA 3.5. Let a(x) satisfy (a,) and (a2) and let (Un)nen be a controlled sequence 
bounded in H'(RN). Let (X,)nen be a drift points sequence for (Un)nen and let 6, = 
On(Xn). Then for all h € (0, 1), 


lim sup uy(x)=0. (3.26) 


NFO Bas, (Xn) 


PROOF. We argue by contradiction and we assume that there exist real numbers h € (0, 1), 
n > O and a sequence (Yn)neN, Yn € Bns, (Xn), such that for large n, 


1 
n(n) > (sup uae) — = > 9. 
Bhiy (Xn) n 


The above relation, combined with (3.24), allows to conclude that, for large n and 
p small enough, 


1 
} uy, dx = ———_ dese: 
Bpn) IBo(yn)| JB, On) 2 


where |B, (yn)| denotes the Lebesque N-dimensional measure of By (yn). 
Hence uy (-— y,) ~ v #0 as n > +00. This is impossible because, by the choice of 5, 
h and y, and by Definition 3.2 up (- — yn) ~ 0 in H'(RY). 


Next lemma contains the key estimate for proving Proposition 2.3. 
LEMMA 3.6. Let a(x) satisfy (a,) and (a2) and let (Un)nen be a controlled sequence 
bounded in H'(RN). Let (Xn)nen be an unbounded drift points sequence for (Un)neNn- 


Then, for all a € (0, ./dog ), there exists a constant Cy > 0 such that for all n, 


Un (Xn) < ye 0 Or) (3.27) 


PROOF. Let a € R, 0 < a < ./do, be fixed, and let us choose h € (Te 1) andae 
(a, NV Agoh). 


Then, by using Lemma 3.5, we obtain that, for any n large enough, u, weakly satisfies 


Aun > a(x)un — up > hun SO in Bhs, (Xn), (3.28) 
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where 6, = On (x,). Thus, since hé, > 1 for large n, we have 
Un(Xn) <|[ undo Vr: 0<rc<l, (3.29) 
By (Xn) 


and we deduce 


1 
unl) < f | f indo | ar= Uy dx. 
0 0B; (Xn) Bi (xn) 


So, in order to obtain (3.27) for large n, it is enough to show that a constant Cy > 0 exists 
such that 


/ Un dx < Eye %™, (3.30) 
By (xn) 


To do this, let us consider the functions 


hdn 
nto) = | Un AX, Wn(p) = ie) ON ene 
Bp (in) 


where wy is the Lebesgue measure of the unitary ball in IR, and let us remark that v, (1) is 
just the left-hand side of (3.30), while 


5N 
< hwyev4~ — < Eye7% 


8n 


wn) = Lee a/h 


for n large enough. So (3.27) follows, by proving v,(1) < w,(1) and taking into account 
that for any finite set u»(xn), n <n, (3.27) is obviously true for a suitable choice of the 
constant Cy. 

Let us then show that for n large 


Un(P) < Walp) Vp €[0, hdn]. (3.31) 
First, let us observe that 
Un(0) <wn(0) WneN, 
and that for n large, by Lemma 3.5, 


Un(hdn) < |Brs,(Xn)| sup un(x) < @ny(hdn)% = wn (Ady). 


Bhiby (Xn) 
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Now, if for some point in [0,/6,] (3.31) were false, then the function (v, — wy)(p) 
should have a maximum point, 6, € (0, 46,), for which (v, — w,)(P;) > 0 and, of course, 


v" (pn) — w" (pn) <0. Let us show that this is impossible. Indeed, since 


p 
Un(p) = / Un(x)dx = i | Un do | dr, 
By (Xn) 0 OB, (Xn) 


p 


we have 


d 
ug(p) = into) = | Un do, 
dp 9Bp (Xn) 


moreover, 


| vn (0) 
Un do = Apna undo = ———_ | 
I Bon) Nonp I Bp (Xn) None 


and, by using divergence theorem, 


e 1 ) 
uy,do = Tee —u, do | dr 
Bp (Xn) 0 Nenr OB, (xn) OY 
D woxer=a tee 
— —_— Au, dx | dr. 
0 NonrN—! LIB) ‘i 


So 


d wv 1 
n(P) — ( Aun dx, 
de NanpX-! = None! Jeon) 


from which, using (3.28), we obtain 


ee alt uv} (p) 


d (v'(p) 1 a*h~ 
= dé (ne) = Noi = Aun dx = pN-t Un(p). 


p 


Hence, taking into account that vj,(o) > 0 and N > 1, 
"” 2,,-2 
U,(p) Za “Un(p) Vo € (0, Abn) 


follows. 


(3.32) 


Let now py, € (0,h6,) be a maximum point for (v, — wy)(e) for which (v_, — 


Wn) (Pn) > O then by (3.32), we get 


U! (Bn) — wh (Pn) > a7h~*(Un (Gn) — Wn(Pn)) > 0, 
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and we are in contradiction. 


PROOF OF PROPOSITION 2.3. Arguing by contradiction, we assume that there are 
a € (0, ./doo ), (Xn)neN and a sequence of integers k, € N such that 


Uk, (Xn) > ne Pn On) 


or, by replacing (Un )nen by the subsequence (xx, )nen, 
= On (Xn) 


Un(Xn) > ne 


By Lemma 3.4 we get on(x,) — +00 so we get in contradiction to Lemma 3.6 whose 
assumptions are fulfilled by (%)nen- 


PROOF OF PROPOSITION 2.6. By using Proposition 2.3, we deduce that, for n large 
enough and a@ € (0, ./doo ), 


i (un)? dx < cx | e APA) dy 
Sn Sh 
k A 
cou f etl 
i=0 ° Sn 


+00 . 
< cak e OPE ENA! at < GoW Heal 
delta 


3.2.2. Gradient estimates. Also in this case, a Caccioppoli-type inequality allows to pass 
to an integral estimate of the gradient. 


PROOF OF PROPOSITION 2.4. For any fixed n €N, let g, € C~ (RN, [0, 1]) be a function 
fulfilling the following conditions: 


(i) @ = 1 on S] 7, 


(i) supp(Yn) C S2.n, (3.33) 
(iii) Agn <C, CER. 


Since u, weakly solves (EI) and g, = 0 in RY \ Son, we have 
i. (—Aun)UnGn) Sif (—Aun)(UnGn) 
Srn RY 
< [uh -acoui)on 3.34) 
RN 


= / (uk — a(x)u2) gp. (3.35) 
Srn 
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On the other hand, taking into account that by (3.33)(ii), @, = 0 and Vg, =0 on 0S2,n 
and using (3.33)(i), we get 


[ (—Aun)UnGn) = / Vuln -0n +f (Vun > V@n)Un 
Son S82. S2,n 


2 1 2 
> Vuy|~ + V{ <u; | -V@n 
Sin Sr.n 2 


1 
=| Viel =f (Agn)uz. (3.36) 
Sin 2 Srn 


So, inserting (3.34) in (3.36), using (3.33)(iii) and taking into account that, if 1 is large 
enough, S27, C S, and a(x) > 0 on S,, we deduce for large n, 


1 
[ [Vunl? < / (un — a(x)un) on + 5 1 (Agn)u, 
Sin S2.n S2.n 


Then, applying Proposition 2.6, taking also into account that for any finite set of in- 
dexes (2.22) is true for a suitable choice of the constant c,, we obtain the thesis. 


4. Multiplicity results 


This section is devoted to the proof of the two multiplicity theorems (Theorems 1.2 and 1.4). 
The proofs will be achieved by using the compactness results proved in Section 2 and well- 
known variational tools, employed for the approximating problems, based on the use of 
Krasnoselskii genus. Traditionally this approach is used for searching constrained critical 
points, however we shall use a recent variant of this method which works with uncon- 
strained min—max classes [43]. This will make working with several functionals at the 
same time easier, will simplify the use of the Morse index and will let us make a final 
application in the next section in a case in which the constrained approach is made difficult 
by a lack of regularity of the constraint manifold. 

So we shall begin by introducing the classical Krasnoselskii genus, then we shall pass to 
the variant introduced in [43], we shall show how the min—max approaches on the natural 
constraint V are equivalent to an unconstrained min—max, we shall introduce the double 
natural constraint VV showing that it enjoys the same property and finally we shall give 
an estimate on the Morse index. After this introductory parts, in the last two parts of this 
section we shall give the proof of the two multiplicity theorems. 
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4.1. Krasnoselskii genus 


We recall some well-known facts about the Krasnoselskii genus in view of its application 
to semilinear elliptic equations of the type addressed here, moreover, we introduce some 
generalizations of those concepts introduced in [43] which will be useful in the following. 
We refer to [26] and [46] for a more comprehensive treatment of the subject. Throughout 
this subsection we shall denote by E any given Banach space. 

Let A C E be asymmetric subset of EF, i.e., A = —A, we define A,(A) as the space of 
Krasnoselskii test maps on A of dimension n as follows 


Ax(A) = {gy € C(A,R") | 9) = —9(-x)}. 
We shall call Krasnoselskii genus of A the number y (A) so defined 

y (A) = inf{n EN| Age Ag(A): O¢ g(A)}. 
We notice that, from the above definitions, for any given g € Ax(A), if k < y(A) then 
0 € g(A), whereas if k > y(A) then there exists g € A;(A) such that 0 ¢ g(A). The main 


properties of the Krasnoselskii genus, which will be useful for the subsequent arguments, 
rely on the following statements. 


PROPOSITION 4.1. Let A be any given symmetric subset of a Banach space and let 
n:A— E bea given odd map. Then y(n(A)) = y (A). 


PROOF. Let k < y(A) and let g € Ag(n(A)). Since go n € Ag(A), then we have 
0 € g(n(A)) and therefore y (7(A)) > k. The thesis follows from the arbitrariness of k. 


PROPOSITION 4.2. Let S C E be any closed subspace of co-dimensionk € N. If A C E is 
any symmetric subset such that y(A) > k, then ANS. 


PRooF. Let S+ be the orthogonal complement of § in E, which is isomorphic to R‘, and 
let P: E — S+ be the orthogonal projection map. Then P € A,(A) and 0 € P(A) so, since 
P-'(0) =S, we have that SN AQ. 


PROPOSITION 4.3. y(S*~!) =k. 


PROOF. Let g € Aerts; by the Borsuk theorem we have 0 € g(Sk-!) and so 
y(S*-!) > k — 1. On the contrary, the canonical injection i: S*~! + R* belongs to 
A; (S‘!) and 0 ¢ i(S*~!), therefore y(S‘~!) <k. 


The next proposition states a trace property for the Krasnoselskii genus. 


PROPOSITION 4.4. Let A C E be any given symmetric subset and let p € Ax(A), with 
k <y(A). Then y(g7!(0)) > y(A) ~ k. 
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PROOF. Firstly, let us notice that gy '(0) is a symmetric set. We take h < y(A) —k and 
we An (y~'(0)). By virtue of the Tietze extension theorem, w may be extended to an 
odd map w € C(A, R*). We introduce the map @ x wx (g(x), W(x)) € R‘*", with 
k+h <y(A). Since gy x wp is a Krasnoselskii test map we have that 0 € (y x y)(A) and 
this means that 0 € w(y—!(0)). So y(y~!(0)) > h and by arbitrariness of h we get the 
thesis. 


4.2. Genus of a symmetric set 


For any k € N, we adopt the following notation: Q; = [—1, i]*, Fi = {x € O, |x; =+1}. 
Given n,k € N, for every x € R'tk we shall split x as x = (x0, X1,%2,..-,Xx) with 
xo € R” and x; € R fori =1,...,k. Analogously, if g(x) € R"+* | we shall write g(x) = 
(~o(x), G1 (x), ..., ME(X)) With go(x) € R” and g;(x) € R fori =1,...,k. Sometimes, we 
shall also use the notation x = (xo, x’), p(x) = (@o(x), vy’ (x)) instead of the previous one, 
by assuming x’, y/(x) € R*. We shall set B, = {x € R” | |x| < 1}, S° =9Bna1 = {x € 
IR’+! | |x| = 1} and we shall denote by E any given Banach space. 

For any given k € N, we set J, = {1,2,...,k} and we denote by 7; the set of all the 
involutive permutations on Jx, i.e., 7 € Px if and only if w: I, > I, and a om = id. Given 
any 2 € Px, we introduce the map 7 : RX + R* so defined 


F(X], X2,..., Xk) = (Xn), X22). ++ Xk): 


We have 


T(t) SOG Cs Ses sn) = Ora Di Axara IeG Oy = 


which means 7 o # = id. Furthermore, given any Banach space E, let us define the map 
wp :E x RK > E x R* such that mz : (xo, x’)  (—x0, 4 (x’)). It is easily seen that mz is 
involutive too, indeed 


re (re(2)) = m6 (~x0, #(x")) = (20. #(@(0"))) = (00.2") = 


and so we also have mg omg = id. We shall set 7 = 7 if E = R”. Now, let A C E be any 
symmetric subset and let gy: A x OQ; > R"+* and 2 € Px be given, we set 


Qn = ogoma:xt> #(9(rEz(x))), 


where 74:A X Ox > A X Qx is the restriction of z¢. We shall refer to gz as to the 
m-symmetric of yg. We shall say that g is 2-symmetric if p = gy, and that gy is symmetric if 
there exists 2 such that gy = g,. We note that (¢7), =To(Topomg)oTA=. 


REMARK 4.1. We observe that if 2 = id g is w-symmetric if 
(S1) go(—x0, x") = —go(xo, x’) Vx € A x Ok, 
(S2) y'(—x0, x") = 9’ (x0, x’) Vx € A X Ox. 
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DEFINITION 4.1. Let A C E be any given symmetric subset, for any k € N we shall say 
that a symmetric function g € C(A x Qx, R"**) is a test function of dimension n for A if 
the following condition holds 

(T) ty;(x) >OWx € Ax FL, Vi=1,...,k. 


We shall denote by A*(A) the set of the n-dimensional test functions for A, obtained 
for any value of k. Then we are ready to define the genus of a set A as the number 


y*(A) = inf{n € N| ay € AX(A)| 8.t.0 ¢g(A x Q,)}. 


Firstly, we remark that, since A*(A) is a larger set than the set A,(A) of the test maps 
related to the Krasnoselskii genus (indeed the last one coincides with the subset of the 
former one which contains the test functions constructed by taking k = 0), we have that, in 
general, y*(A) < y(A). By definition, given any gy € A} (A) with n < y*(A), 0 € (A). 

In view of proving the analogous statement of Propositions 4.1—4.4 for the genus y*, we 
prove some useful lemmas stating some properties of the test functions. 


LEMMA 4.1. Let gp: A x Ox > R"** satisfy (T) and let 1 € Py be given, then gq also 
Satisfies (T). 


PROOF. Let x = (x0, x’) € A x F>° fori =1,...,k. Then @(x’) € Fra and, since ¢ sat- 
isfies (T), we have 


£¢9z(i) (TE (x0, x')) = E ex) (—x0, 7 (x')) > 0. 


By the previous definitions we know that g,(;) = (7 0 g); and so (7 0 @)j(a%E(x)) SO, 
that is, +(~,,);(x) = 0, as stated in the thesis. 


LEMMA 4.2. Let A C E be any given symmetric subset. Then every test function ~ € 
Ay (A) can be extended to a map in Ay (E). 


PROOF. Firstly, by virtue of the Tietze—Dugundji theorem (see [22]) we take an extension 
of the components gy; on E x F-~ valued in R+ keeping the sign property (T), then we 
extend them and gp continuously on all of E x Q, so getting a map @: E x Ox, > R"** 
which, obviously, satisfies (T). By Lemma 4.1, the map ¢,, which is an extension of ¢,, 
satisfies (T) and the same happens for g, = 5 + 5x [Ex On> R"+* where a € P, is 
such that g is z-symmetric. Obviously, gs; is symmetric since 


— 


1_ 1 _ 1_ x 
(¢s)ax = zon c 3 Gx )x = zen + 5° = s, 


so gs € AX(E). If x € A x Ox then g(x) = gz (x), hence g(x) = P(x) = Gz (x) and so 
(x) = @s(x). Therefore gy; extends ¢ to all of E. 


The property in Proposition 4.1 also holds for y*. 
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PROPOSITION 4.5. Let A C E be any given symmetric subset and letn: A > E bea given 
odd continuous map. Then y*(n(A)) > y*(A). 


PROOF. Let n < y*(A), g € An((A)) and let 4(xo0, x’) = (n(x0), x’), 7:4 X On > 
n(A) x Qx. Given m € Px, we have 


Qq =HOPOMA=MOPOHOCHA =H OPOM(A) ON = Gq ON. 


Therefore, if we fix a such that g is z-symmetric, that is, gp = g7, then @; =pon=@, 
hence also ¢ is symmetric. Since 7(A x F-~) = n(A) x F;~, we deduce that ¢ satisfies (T). 
Thus @ € A} (A), hence 


0€ G(A x Ox) = (H(A x Ox)) = G(n(A) x Ox). 


It follows that n < y*(n(A)) by the arbitrariness of g and, consequently, y*(A) < 
y*(n(A)) by the arbitrariness of n. 


Proposition 4.2 directly applies to y* since y*(A) < y (A). 
In order to prove the analogous of Proposition 4.3 we need a topological lemma which 
states a more general property than the Borsuk theorem. 


THEOREM 4.1. Let f: By x Qk > R"t* be a continuous map symmetric on 0Byn x Qk 
(i.e., such that for some m € Px, f (x) = fr (x) Vx € S"~! x Ox) and assume that (T) holds 
for g = f and A= By. Then there exists x € Bn x Q, such that f (x) =0. 
PROOF. The first step consists in introducing a suitable change of variables which will 
allow to deal with the symmetry properties involved in the most convenient way. 

For given k € N and zw € Px, let us introduce the sets 


Ih={iehk |i=x@}, h={iekli<a@}. 


We note that, if kj = /;, ko + 2k; =k. Let us introduce the functions p; and p2, both 
defined on R* as 


PIX) = (jj + xa@)ier + Qien, P2(x) = (Xj — Xa) )iel- 


We have R* = pi(R*) @ p2(R*). Then for every x € By, x Qx, we set 


x1 = (x0, p2(’)), 2 = pile’), 
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and so we have x = (xo, x’) = (x1, x2). Analogously, for any f = (fo, f’) € R"**, we 
define the functions 


f; =(fo. p20 f’), f= pio f’, 


and so f = (f;, f2). Now we observe that x; = 0 if and only if x9 = 0 and, for every i € Ik, 
Xj = Xn (i), that (—x1, x2) = (—xo, 7(x’)) = 7 (x) and that, consequently, f 2-symmetric 
means 


f (—X1,X2) = 1 ((%1, X2)) = (—f1 (1, x2), fo (K1, x2). (4.1) 


We assume by contradiction that 


k 
0¢ f(8(Bn x Qx)) =i (ior x Ox) U|_J(Bn x (Ft U FE n) 
i=l 


In such a case, we shall show that the topological degree of f in zero is different from 
zero, that is, deg(B, x Qx, f,0) #0. The first step in this direction consists in forcing 
the assumption (T) to be satisfied with strict inequalities, by adding to f’ the function ex’ 
with ¢ > 0 suitably small in order to keep the value of the topological degree. We just 
remark that the function g: (xo, x’) > (0, x’) is 2-symmetric, as it can be easily seen. 
Then, through a linear homotopy, we can pass from /f to 5( f+ fx), which we will continue 
to denote by f. By Lemma 4.1 we know that the symmetrization does not change the 
degree since f is not modified on 0B, x Q; and fj; and (f,,); havea fixed sign on By, x Fe. 

By a standard perturbation argument we can also assume f € C!(By x Ox, R"+*). We 
set X = {x e R'+k | x; = O}. We shall introduce further modifications of f which make 
f7!() 9 X contain only regular points. Firstly we know that, by the oddness of f, with 
respect to the variable x; stated in (4.1), f} =0 on X and so the zeros of f on X are the 
zeros of f. Then we observe that, since after the previous symmetrization fz is even with 
respect to the variable x;, so the partial Jacobian matrix Jx, f(x) is identically zero for 
every x € X. Then, for any x € X, by Laplace rule we get |J f (x)| = | Jx,f1 (x) || Jx,f2(x)|- 
We can force |Jx,f2| 4 0 on every x € X such that f2(x) = 0 by subtracting from f2 a 
small regular value h € p;(R*), given by the Sard theorem. Note that this perturbation 
does not affect the symmetry properties of f and, if h is taken sufficiently small, does not 
change the value of the topological degree. In particular, we get that f—'(0) 0 X is a finite 
set and therefore the set L which contains all the eigenvalues of Jx,f;(x) in the points of 
f —1(0) N X is also finite. Then we can force the determinant | Jx,f1(x)| to be different 
from zero in such points by adding to f| the function —Ax; with A € R\ L. Again, this new 
perturbation preserves the symmetry properties of f and, if 4 is sufficiently small, does 
not change the value of deg(B, x Qx, f,0) and the zeros of f2 remain of course the same. 
So we can be sure that f has only regular zeros on X. 

Now, since f2 satisfies the hypotheses of the Miranda theorem (see [33]) on X = Ojo +k,, 
we can state that f~!(0) 1 X is composed by an odd number of regular zeros. By conti- 
nuity, we have that there exists a small ¢ > 0 such that the closed tubular neighborhood 
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= {x € By x Qx | d(x, X) < €} contains only regular zeros. In order to force 0 to be a 
regular value for f we have to deal with the set (B, x Q,) \ X¢ and, to this aim, we argue 
as follows. 

Let Av = {x € Bn xX Qx | tx! > 2 ay where, fori =1,...,n+k1, x! is the component 
of x; of index 7. One can easily see that 


n+k, 
(Bn x Ox)\ Xe C J (47 U 47). 


i=1 


We are going to perform a new perturbation of f, which keeps the symmetry properties 
and is too small to change the topological degree or to introduce singular zeros in X¢, 
in order to exclude the presence of singular zeros of f also on Aj. Let S be the set of 
singular values of f. By the Sard theorem S U 7(S) is a negligible set, so we can take 
hy € R"** \ (SU z(S)) arbitrarily small. Let g:IR > [0,1] be a smooth function such 
that g(x) =0 for x <0 and g(x) =1 for x > 1. Let y:R” > R"t* be defined as (x) = 
g(2x})h1 +g(—2x})z (h1). One easily sees that (x) = hy if x € AT and W(x) = 7 (h)) if 
x € A, .So the function f :xh> f(x)— (x) has no singular zeros on At UA, . Moreover, 
f keeps the symmetry properties of f. The value of the degree and the regularity of the 
zeros in X, are preserved by stability, provided h, is taken suitably small. 

We proceed in this construction through n + kj steps, from i = 1 toi =n+k . Thanks to 
the stability property of the regular points, we are sure that at each step the regularity gained 
at the previous step on X, U ee (At U Aj ) is kept, provided the perturbation term h; 
given by the Sard theorem is chosen sufficiently small. Therefore, we can conclude that we 
have regularity everywhere on B, x Q, and so 0 is a regular value for f. Finally, we know 
that f!() ™ X is made by an odd number of points and, since f7!() — z(f—'(0)), 
f~!() \ X is made by an even number of points, indeed (x) 4 x for x ¢ X. Then we 
can conclude that deg(B, x Qx, f,0) is odd and so we get the thesis. 


REMARK 4.2. It is worth to notice that the previous theorem reduces to the Borsuk the- 
orem when k = 0 and to the Miranda theorem when n = 0 and x = id. If it is easy to see 
that Miranda theorem can be deduced from the Borsuk theorem, nevertheless reconducing 
the above statement to the Borsuk theorem does not seem to be an obvious task. 


PROPOSITION 4.6. y*(S")=n+1. 
PROOF. We know that y*(S”) < y($”) <n + 1. On the other hand, let g € A}(S”) and 


let SU = {(x1,...,X%n41) € S” | Xn41 > O}. St is homeomorphic to B, and so, by Theo- 
rem 4.1, there exists x € St x Ox such that p(x) =0. Son < y*(S"). 


Also the trace property in Proposition 4.4 is enjoyed by y*. 


PROPOSITION 4.7. Let A C E be any given symmetric subset and let gp € Ax(A), with 
k <y*(A). Then y*(y~!(0)) > y*(A) —k 
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PROOF. Let k <n < y*(A) and w € AX_,(y7'@)), 4:97!) x Qn > R"**", By 
Lemma 4.2, wy can be extended to w defined on all of E (and so on A) and such that 
yr © A*_,(A). Let us consider the function g x w:A x Qn > R"t* defined as 


(y x W)(x) = (9X0), WX) = ((G0), Wo(x)), W(x). 


It is easily seen that y x w satisfies (T), since the components involved in such condition 
only belong to yw. Moreover, if 2 € P;, then 


E(x)))) 


(v'(te@))))) 
Wr) ze(2))) 


t((y x W)(re(x))) = 2((9(—x0), Vo(7e(2)), W 
= ((- ) 
= ((9(0). 0 W)o(t2@)). 
= (¢ x Wx) (x). 


g(—xo0), —Wo(ze (x) 


(x 
(70 


Therefore (y x W)z7 = X Was hence since y is symmetric, then also g x w satisfies 
the same condition. Thus g x wv € A,(A) and then 0 € (@ x Wy(A x Q)), that is, 0 € 
wp" *) x Qn). _ 

By the arbitrariness of wv, we get n — k < y*(g~!(0)) and by the arbitrariness of n, the 
thesis follows. 


A different trace property, which actually is the main motivation for passing to the 
present variant of the notion of genus, can be now also proved. 


PROPOSITION 4.8. Let A C E be any symmetric subset and let 0: A x Qx — E and 
gp: E > R* be given. If there exists 1 € Px such that 

(a) Vx € A x Ox: o(E(X)) = —o(X), 

(b) Vu € E: p(—u) = 2 (glu), 

(c) Vx CA x FO: tyj(o(x)) 20Vi=1,...,k, 
then y*(a(A x Ox) NG! (0) > y*(A). 


PROOF. Firstly we observe that conditions (a) and (b) allow to state respectively that 
o(A x Qx) and yg '(0) are symmetric subsets of FE and so the assertion makes sense. 
We fix n < y*(A) and a test function w of dimension n defined on (0 (A x Ox) N gy! (0)) 
and extended by Lemma 4.2 on E. Then y:E x Q;, > R"*" satisfies (T) and is sym- 
metric for some mz, € Py. Let us define p € Pri, such that p(i) = 7, (i) if i <A and 
p(i)=h+n(i —h) if i > h. In this way, if x’ € R"** is decomposed as x’ = (z’, y’) with 
z’ € R" and y’ € R*, we have f(x’) = (71 (z’), 7 (y’)). We define 0: A x On, > RUth+* 
by setting 


9 (x0,x') = B (x0, 2', ¥') = (W(o (20, »’), 2’), (0 (0. y’))), 


that is, }o = Wo and 0’ = (W’, vy). We are going to prove that 3 € A*(A). Since w satis- 
fies (T), we have that, fori <h, 40; =+w; >Oif z’¢€ F~, whereas condition (c) states 
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that +0;4; = +g; > 0 if y’ € F* and so ® satisfies (T). Moreover, by (a), (b) and the 
symmetry of 7, 


9 (pE(x)) — 0 (—x0, 71 (z’), i (y 


~S 
— 
— 


/ 


o(o (x0. »’).z 


).m 
0(o (x0, 9’), 2’), BCH’ (a (20, y’), 2’), (4 (x0, y’))) 
) 


Then # is symmetric and so ¥ € A}(A) as claimed above and, since n < y*(A), 
0 €0(A X Qnix). This means that there exist x9 € A, y’ € Qx and z’ € Qy, such that 
W(o(x0, ), 2’) =0 and g(a (x0, y’)) = 0. So 0€ W(((a(A x Qk) NG !(0))) x On). By 
the arbitrariness of w, one getsn < y*(o(A x Q4)N g ! (0)) and by the arbitrariness of n, 
one gets the thesis. 


4.3. Min—max classes on the natural constraint 
Let J: H > R be one of the functionals related to the problem (CP) or to the problem (P), 
with H = Hy (2) or H = H}(RY), respectively. Let V be the natural constraint defined 
in (1.16). For any fixed n we introduce the class of sets 

ag = {A CV | Acompact, y*(A) > n} 


and denote by c, the corresponding min—max level, that is, 


Cn = inf sup/(u). 
AcI,’ ueA 


We assume c,, > 0. Such an assumption will let us find a neighborhood C7 of 0 such that 
foreveryuEeC, 


I(u) < A Vi(u)-u>0, 


in conjunction to which we take a neighborhood of infinity CT such that for every u € C7, 


Iu) <0 andtherefore VJ(u)-u <0. 
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Let us observe that, given any u € VY, the function a +> I (au) is strictly increasing 
between 0 and 1, strictly decreasing after 1 and tends to —oo as a — +00. So two con- 
stants €,c > 0 such that eu € C~ and cu € C* always exist. Moreover, if A is any compact 
subset of VY, ¢ and c can be uniformly fixed for u € A, also € can be fixed in maximal way 
and c can be fixed in minimal way such that both the values turn out to be considered as 
functions of A. We introduce the function 04: A x [—1, 1] — H, defined as 


c-—eé 
oA(u, a) = (cta+n 5 )u 


satisfying the conditions 

oa(u, —1) =eu, oa(u,l)=cu WueA 
and the set 

X4=04(A x [-1, 1) 


which will be named simple homothetic expansion of A. Let us notice that if A € [7 yy then 
oa belongs to the class of continuous functions defined by 


Fr={o: Ax[-1,l]> H|Ae ny, 
Vue A: o(—u,a) =—o(u,a@), 
o(u,—l) eC ,o(u, 1) ECT} 
and 2’, belongs to the class of sets defined by 
m={XcH#\{o yer’, 
do: A x [-1,1] > H,o € Fy, st. X =0(A x [-1,1])}. 
Let us introduce two further classes of continuous functions and sets, namely 
Fr ={o:H > R| g(-u) =—9lu), 
gu) <0WuE HNC, gu) >0WWE HNC}, 
| {xX Cc H \ {0} | X compact, X =—X, Vpe Fe: y*(xn y '(0)) >n}. 
LEMMA 4.3. I, C I. 


PROOF. Let ge F*, AE ry, o:Ax Q| > H, o € Fy be fixed. By virtue of Theo- 
rem 4.8 we have y*(a(A x Q1)N gy !(0)) >n. By the arbitrariness of g € F*, we get 
o(Ax Qi) ET. 


LEMMA 4.4. For every A € I*, we have AN Ve ny, 
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PROOF. To prove the statement it suffices to note that the function g:ut > VI (u) - u be- 
longs to F;* and hence, by the definition of ;*, the thesis follows. 


LEMMA 4.5. IfA€ ps then supy, | = sup, J. 


PROOF. The assertion trivially follows from the definition of X'4. 


LEMMA 4.6. infacr, SUPye, 1 (U) = infzers SUPyeg TU) = Cn. 
PROOF. By virtue of the inclusion Tj, C I*, we have 


inf sup7(u) < inf sup J(u). 
Aeli ucA AeIn wed 


Moreover, for every X € I", from Lemma 4.4 we have 


Cn < sup <sup/(u) 
ueXNV uEx 


and so, by the arbitrariness of X, cy < infacrs SUP,c, /(u). Finally, by Lemma 4.5 we 
have that, for every X « I" v since iy € Ty, 


inf sup/(u) < sup T(u) = sup J(u). 
ElnycdA ueLyx ueXx 


By the arbitrariness of X in sete we have 


inf sup/(u) < inf sup/(u) =cp. 
Aeln wed AelY ued 


PROPOSITION 4.9. Ij, and I,* are two admissible min-max classes. 


PROOF. Since cy > 0, we can find deformations 7 reducing the level c, and leav- 
ing unchanged the sublevel of a Obviously such deformations do not change the sets 
C~ and C7. It follows that if o € F, and gy € Fx then noo € F, and soif A € Jj, then 
n(A) € I, and if A € Iy* then n(A) € F;¥. 


By the above results we can state that, for every n, the min—max levels of the classes 
inl ig are all critical levels provided they satisfy the Palais—Smale condition, regardless any 
regularity property of the constraint since they are levels of the unconstrained admissible 
min—max classes Ij, and I". The corresponding critical points have also a characterization 
of unconstrained min—max points with the relative properties like estimates of the Morse 
index or others. Moreover, the three classes are equivalent from the point of view of the 
localization of the critical points near the maximum points of the terms of a minimizing 
sequence of sets, as stated in the next proposition. 
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PROPOSITION 4.10. If (An)nen is any minimizing sequence in sae ie., for everyn EN, 
An € ry and lim (supye4, 1(U)) = Cn, then the sequence of the homothetic expansions 
(4, nen iS a minimizing sequence in Ty, (and so, in particular, in [*). 


PROOF. The assertion easily follows by Lemma 4.5 and by Proposition 4.9. 


PROPOSITION 4.11. If (An)nen is any minimizing sequence in I;* (and so, in particular, 
in I;,) then the sequence of the traces on V(An NO V)nen is a minimizing sequence in EV 


PROOF. The assertion easily follows by Lemma 4.4 and by Proposition 4.9. 


4.4. Min—max classes on the double natural constraint 


In this subsection we shall apply the above introduced notion of genus to the study of 
the min—max classes on the double natural constraint. To this aim we fix 2 € P2, a # id, 
so that we simply have z(1) = 2, 7(2) = 1, and consequently we fix the maps 7 and 
mp as defined in the previous subsection. Let 2 C R* be given and let J: H > R be 
the functional defined in (1.15), related to problem (SP), with H = AA (2). For every 
x € Q, we set, as usual, ut (x) = max(u(x), 0), u~ (x) = max(—u(x), 0). Let A; be the 
first eigenvalue of —A on §2, we suppose A < 4;. Let W be the double natural constraint 
so defined 


W = {u|u* 40, VI(u)-u*=0} cY, (4.2) 
we set for n > 1, 

ry’ ={A CW] A compact, y*(A) >n} 
and 


Cn = inf sup/(u). 
AelnW ucA 


Since 4 < A, then there exists a ground state level c > 0 so, for every n, cy > 2c since, for 
every u € W, I(u~) >C (see [14]). Let us introduce the sets 


c= |uen\ (01109 < via 20], 


é 
3 
Ct = {ue H \ {0}| J(u) <0 (and so V/(u)-u <0)}, 


Ly = fue H\(0)| 10) <en— 5}. 


Let us observe that, being 4 < A1, given any u € H \ {0}, the function a+ I(au) grows 
with a positive derivative for a small as far as it reaches its maximum, then it has a negative 
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derivative and tends to —oo as a — +00. So two constants ¢,c > 0 such that eu € C~ 
and cu € C* always exist. Moreover, if A C H \ {0} is any compact set, ¢ and c can 
be uniformly fixed for u € A, as well as, if A C W, for u € A*~ = {u~ | u € A}, since 
A~ turn out to be also compact sets which do not contain 0. Furthermore, ¢ can be fixed 
in a maximal way and c can be fixed in a minimal way so that both the two values can be 
considered as functions of A. We introduce the function 04: A x Q2 — H, defined as 


c—€E 


C—E _ 
aa(u.a,p)=(e+(@+1) 5 Jur-(e@HD 5 )u 


and the sets 
Ca=o4(Ax0Q2) and 4 =a0,4(A X Qo). 


We shall refer to X'4 as to the double homothetic expansion of A. Let us notice that if 
A€é En” and sup, I < cy, + a then o,4 belongs (see Lemma 4.9) to the class of functions 
defined by 


Fn={o:Ax OQ. > H| Aer and 1,2,3 hold}, 


where 
(1) o@tn(x)) =—o(x) Wx € AX Q2, 
(2) o(u,a, B) € Ly and o(u,a, B)t € C* if =+1, 
(3) o(u,a, 8) € Ly ando(u,a, 6B) €C~if B=+1. 
Therefore 24 belongs to the class of sets defined by 


Tn={XcH\O}a4e nr”, 
do:A x O27 > Ho € Fy, 8.t. X =0(A x Qy)}. 


Let us introduce two further classes of continuous functions and sets, namely 
F* ={o:H > R*|1*,2*, 3* hold}, 


where 

(1*) g(-u) =7(gu)), 

(2*) +o,(u) >O0ifue Ly, and ut €C*, 

(3*) +g2(u) >O0ifue Ly, andu7~ €C~, 
and 


Dx = {X CH \ {0} | X compact, 


X =—X and Vy ¢ FF: y*(XNg'(0)) Sn}. 


LEMMA 4.7. [, c 1%. 
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PROOF. Let ge F*, AE ry, o:A x Qo > H, o € Fy be fixed. By virtue of Theo- 
rem 4.8, we have y*(o(A x Q2)N gy !(0)) >n. By the arbitrariness of g € F*, we get 
o(Ax Qe Tl. 


LEMMA 4.8. For every Ae I*, we have ANWe pas 


PROOF. Let g(u) = VI (u) - u cut off by a positive constant near 0 so that g(0) > 0. To 
prove the statement it suffices to note that the function g::u t+ —g(u*) € R* belongs 
to F* and hence by the definition of [>* the thesis follows. 


LEMMA 4.9. [fA € Bee then sup ys, 1 = sup, / and supc, J < sup, J — 26. 


PROOF. Of course, A C 24 so supy I < sup y, I. Conversely, if wu € X'4, u has the form 
u= put + vu with a € A. Since u* € V, we have 


I(u) = 1(ui*) + Teva) < 1(@*) + 1G) = 1H) < sup I. 
A 


If uw € Ca, then {u,v} {e,c} 4B so [(u~) — T(u*) Se — 
and “—” sign. 


for at least one of the “+” 


WIS 


LEMMA 4.10. The min—max levels of the above defined classes are the same, i.e., 


inf sup/(u)= inf sup/(u)=cp. 
ElnyucA el ue A 


PROOF. By virtue of the inclusion ly, Cc 7*, we have 


inf sup/(u) < inf sup/(u). 
Aelt nel : aera 


Moreover, for every X € I;*, from Lemma 4.8 we have 


Cn < sup <sup/(u) 
ueXNW ucex 


and so, by the arbitrariness of X, cy < inf4c re SUpyea 7 (u). Finally, by Lemma 4.9 we 
have that, for every X € Ly, since iy € Ih, 


inf sup/(u) < sup 7(u) = sup J(u). 
A€In wed ucedyx ueX 


By the arbitrariness of X in i. we have 


inf sup/(u) < inf supl(u)=cp. 
AelIn wed AcelY ued 


PROPOSITION 4.12. I, and I* are two admissible min-max classes. 
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PROOF. Since c, > 0, we can find a cut-off function g such that g(c,) = 1 and g(s) = 0 
fors <cy— ¢ (see [44,46]). By multiplying the gradient VJ (uw) by g(J (u)) we obtain a cut- 
off gradient flow 7:IR x H — H which lets the points at level c, move along the reverse 
gradient direction and leaves the points in L,, fixed. It follows that, setting n;:x b> n(t, x), 
ifo € F, and y € F;** then n; oo € F, and yom €F,. Soif A € I, then 7;(A) € I, and 
if A € I* then n;(A) € I-*. 


By the above results we can state that, for every n, the min—max levels of the classes 
in Le are all critical levels provided they satisfy the Palais—Smale condition, regardless 
any regularity property of the constraint since they are levels of the unconstrained admis- 
sible min-max classes Ij, and [;*. The corresponding critical points also have a charac- 
terization of unconstrained min—max points with the relative properties like, for instance, 
the direct estimates of the Morse index in the whole space. Moreover, the three classes 
are also equivalent from the point of view of the localization of the critical points near 
the maximum points of the terms of a minimizing sequence of sets, as stated in the next 
proposition. 


PROPOSITION 4.13. If (Aj)jen is any minimizing sequence in Pe ie., for everyi Ee N, 
Aj € pe and lim; (SUPy cA; I(u)) = Cn, then the sequence of the double homothetic expan- 
sions (274, ieN ts a minimizing sequence in I, (and so, in particular, in °*) for i large. 


PROOF. The assertion easily follows from Lemmas 4.9 and 4.10. 


PROPOSITION 4.14. If (Aj)jen is any minimizing sequence in I* (and so, in particular, 
in I;,) then the sequence of the traces on W(A; 1 W)jen is a minimizing sequence in RM. 


PROOF. The assertion easily follows from Lemmas 4.8 and 4.10. 


It is worth to remark that the two previous propositions imply, in particular, that the 
admissible min-max classes I, and I,* produce Palais-Smale sequences in W. 


4.5. An estimate on the Morse index 


As an example of the utility of working without constraints and in view of an application in 
remaining part of this subsection, we shall briefly show a rough estimate which states that 
at the level c,, we can find critical points in which the augmented Morse index is greater 
or equal to n — | (the sharp estimate would give: greater or equal to n). The proofs follow 
the ideas in [27], to which we refer for more details. Firstly we shall take into account the 
case in which at level cy we only have nondegenerate critical points. In such a case we 
shall show that each one of such points can be avoided, in the sense that every minimizing 
sequence can be modified in order to have an empty intersection with a neighborhood 
of such a point, if it has a Morse index smaller than n — 1. If all the points are in this 
situation, we can find a minimizing sequence of sets far away from all the critical points 
at level cy, getting in contradiction in case of compactness. This argument is based on a 
simple topological lemma, see [27]. 
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LEMMA 4.11. Let C C R‘~! be a compact set and let f :C —> RN \ {0} be a continuous 
map. Then f has a continuous extension from RN—! to RN \ {0}. 


PRooF. By the Dugundji theorem [22] f has a continuous extension f from R“~! to RY 
which is C! out of C. By the Sard theorem f(R%~! \ C) is a negligible set because it 
cannot contain regular values. By compactness we know that a positive number r > 0 such 
that B,(0)M f(C) = @ can be chosen. Then 


B(0) ¢ f(C)U f(RY-'\C) = f(R™"). 


So we can find 7 € B,(0) \ f(RX~!). We denote by p the projection of B,(0) from y 
on 0B,(0) extended by the identity out of B,(0). Then po f is the desired extension. 


Now, let u be a regular critical point at level c, and let E_ and E,, respectively, denote 
the subspaces of Hy spanned by the eigenvectors corresponding to the negative and positive 
eigenvalues of V71(it), so that we can find a constant m > 0 such that 


Vus € Ez: +V7I(i)(ust)- us > miu’. (4.3) 


For two given r+ > 0, let Be = B,,(0)N Ex, Sz = OBy in Ex, B’ =u + B_ + By and 
B=u+ (Bi, (0)N E_) + By. We shall split u € B’ asi + uy +u_ with ux € Be. Let 
Oe 


us divide B’ in two parts, 


By = {ue B | V7 1a) (u4) uy > -2V7T(@)(u_) - u_}, 


By = B'\ By. 

Note that by (4.3), 
Vue € By: +V7I(@)(u)-u4 > 5 lle > const - |lu|I7, (4.4) 
Vut € Bo: +V71(a)(u)-u— <—m|lu_||* < —const - |u|. (4.5) 


So, if we fix ri conveniently small, we can respectively deduce that 


Vue Ee By: +VI(u)-u+y 20, (4.6) 
Vue EB: t1(u)<ITU)=c. (4.7) 


Furthermore, by also choosing r_ suitably smaller than r+ we can also assume that 


inf I>5p,>Cp. (4.8) 
u+B_+S + 


In a more regular context the following lemma can be proved in a slightly easier way by 
using Morse lemma instead of the previous construction. 
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LEMMA 4.12. Let u be a nondegenerate critical point of I at level c,. Then for every 
A €I;* such that sup, I < Sp there exists A’ € I* such that 


A’ \ (B'U—B’) = A\ (B'U-B’), (4.9) 
A'NBCu+t+E, (4.10) 
sup 7 < sup I. (4.11) 
A A’ 


PROOF. Let 7: B’ > B’ be defined by 
nu) =n +u_+usz) =u +u_+a(u)uy, (4.12) 


where a@(u) = (2 |u| —1)t. Son =id on a + S_ + B,. We define 7 in a symmetric 
way near the symmetric critical point —u and we extend it by identity on all of Ai. We can 
assume that B’ does not touch Cx, so 7 leaves the two sets fixed. The map 7 so extended 
turns out to be discontinuous only on the sets +(u + B_ + S+;) where the functional / 
takes values greater or equal to s,.So AN(a@+ B_+S$,)U-—(@+ B_+S)) =@ and we 
can modify 7 in order to restore the discontinuity without modifying the values on A. Let 
A’ = (A). Since 7 is odd and leaves the sets Cx fixed, (A) € I. Moreover, (4.9) follows 
by easy considerations since 7 = id on A \ (B’ U—B’), (4.10) holds because if u € B then 
a(u) =O and nu) =u+u_ eu E_. Finally, (4.11) trivially follows from 


Vue B’:  I(n(u)) <max(Z(u), cn), (4.13) 


as we are going to check. Indeed by (4.6), 


1 
ru) = (nw) = f Vida +tu_+su,)-ut ds >0, 


a(u) 


ifu+u_+a(u)us =n(u) is in By. Otherwise by (4.7), T(n(u)) < en. 


The above result can be improved by the use of Lemma 4.11, if we assume that the 
Morse index of u, namely dim E_, is smaller than n — 1. 


PROPOSITION 4.15. Let u be a nondegenerate critical point at level cn and let dim E_ < 
n — 1. Then we can find two arbitrarily small neighborhoods B and B' of iu such that 
(4.9) and (4.11) and 

A'NB=G (4.14) 
hold. 


PRoorF. Let A’, B, B’ be as in the previous lemma. We shall show that A’ \ (BU —B) still 
belongs to 1>* and therefore it satisfies the properties in the thesis. Indeed, assume to have 
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y € F* and w € A"“1((A’ \ (B U—B)) Ng~!(0)) such that 0 ¢ W(((A’ \ (BU —B)) N 
y'(0)) x Ox). By (4.10), 


T =(A’\ (BU-B))N(A‘NB) Ng!) CH+E. 


We have w: ((A’ \ (BU —B)N g7!(0)) x Ox, > R"~!** \ {0}. We want to extend y 
to ((A'N B)N gy '(0)) x Qx and we must extend it from T x Q; which is the common 
boundary of the set on which yw is already defined and the set to which it must be extended. 
We can firstly extend, by the Dugundji theorem, the components +wWj, i = 1,...,k, to 
(AN B)N g-! (0)) x F to positive values and then all the other components in order to 
have 


wi(T x Op) U((A'N BOG '(O)) x AQx) > R”'** \ {0}. 
Since 
(T x Qn) U((A'N BN g™!(0)) x 9Ox) CW + E_) x RE 


and (4 + E_) x R* is a linear space of dimension strictly smaller than n — 1 + k, by 
Lemma 4.11 we can extend y to (T x Ox,) U((A’N BN gy '(0)) x Qx) with values in 
IR’—!+4 \ {0}. Symmetrically, we can also extend y to ((A! N-—BM@g—!(0)) x Ox) and 
therefore to all of (A’N go! (O)) x QO, with values in Reais \ {0}, in contradiction to the 
condition A € I;*. 


By iterating this flattening and excision procedure, if J has only (a finite number of ) 
nondegenerate critical points at level cy, and all of them have the Morse index strictly 
smaller than n — 1, we can easily find a minimizing sequence (A;)jcn in (* whose terms 
have an empty intersection with a fixed neighborhood V of the set K,,, of the critical points 
at level c,, getting in contradiction in case of compactness. 

In the general case, one can take advantage of the Marino—Prodi perturbation argument, 
(see [27,32,40] and [41], Chapter 3, Section 5) which allows one to reduce K,,, to a set of 
nondegenerate critical points and to consequently deduce the following result 


PROPOSITION 4.16. If I satisfies PS at level cy there exists u in K.,, which has an aug- 
mented Morse index greater or equal ton — 1. 
4.6. Multiple solutions to the problem at critical growth 


We can now give the proof of Theorem 1.2. Let us choose a sequence (py)nen in ]2, 2*[ 
such that p, — 2* and introduce the functionals 


1 x 1 
m= 5 | Ivor > | pe — | Io, 
Q 2 Pn JQ 


whose critical points are solutions to problems (SP) for p = pn. 
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Let V be as defined in Section 1.4 and Y, the analogous constraint for J = I’. Let 


ck = inf sup ,(v) 
Ach veA 


and 


c= inf, sup I; (v). 
Aen," veA 


By the results of Section 4.3, we see that every cx, can be also regarded as the min—max 
level of J on the class of sets I; or I; as The same conclusion holds for Ch and, by a suitable 
choice of the sets C~ and C* which can be uniformly fixed with respect to n, cy can be 
seen as the min—max level / 7 on the same classes J} and LF as before which, therefore, 


do not depend on n. 


LEMMA 4.13. [fA <A, then cx > 0 and, for every n € N, cy > 0. 


PROOF. Let A € 1, by Proposition 4.2 AN Et, 4B. Letue AN EL, CVN EZ. 


By the constraint equation, 


! 2 2 i d 2 
1a) = 5( five =f w?)>5(1- 2) f iva 


The constraint equation also implies 


: Xr 
jul? = f |Vul?—-a fp jut? >(1——) | [vel, 
Xr 
22 2Q 2Q k 2 


which implies 


3 x 
(eo a (1 = ~)s 


and therefore 


I>I1(u) [uP >a i= s) 
sup/ > I(u) = — ul’. >= —— : 


Taking the infimum for A € I; Hd we finally have 


The second part of the thesis can be proved in the same way. 


The proof of Theorem 1.2 will follow from the following two lemmas. 


(4.15) 
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LEMMA 4.14. limy—+o0 cy = Cx for any k as in the previous lemma. 


PROOF. Letus fix k € Nand A € IX, then for any u € A, I}'(u) > I,(u). Being A compact 
and the functionals equicontinuous, 


sup [;'(u) > sup Lh, (u). 
ucA ucA 


Then lim sup, cy cy < sup,c,4 (vu) and, being A an arbitrary set in I, we get 


lim sup cy < cx. 
n—>+0o 


Since for s > 0 the function h(s) = ao _ xs? gets its maximum value in s = 1, we 
n 


have h(s) < ne _ a for all s > 0. Therefore for every u € H, 


Du) < E(u) + (— az = ie 


so, for any k € N, 


ck < liminf c? 
n—>+00 


and we have the thesis. 


LEMMA 4.15. limg_++00 ck = +00. 


PROOF. We want to remark that such a result is not based on compactness properties be- 
cause, if we prove the statement for A > 0, i.e., when we have compactness, the statement 
itself is obviously true when A < 0 and compactness fails. Moreover, this lemma is also 
true in lower dimension, as we can see, in the same way, by adding a suitably big sub- 
critical term. On the other side, the use of compactness techniques takes advantage of the 
previous results in this chapter. Let us suppose, by contradiction, that the sequence (cx) cen 
is bounded, hence it converges to a real number c. For any k € N, by Lemma 4.14 there 
exists ng > k such that Icy —ck| < i hence 


lim ci) = lim Ck=C (4.16) 
k>+00 k—>+00 


and the sequence (”x)xen iS diverging, i.e., 


lim ng = +00. 
k—>+00 


Let un, be a solution of (SP) at level ce . Using the Morse index estimates on min—max 
points as in Section 4.5, we can select the sequence (Un, )xeN such that every up, has an 
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augmented Morse index greater or equal to k — 1. By our assumptions, we can claim that 
the sequence (Uy, )xeN 1s bounded in Hy ($2). Indeed, being uy, a solution to (SP) we have 


1 1 
1, (ing) = (5 - = We \Un, [Pre >, (4.17) 
Nk 


which gives the boundedness of —Auy, in H —! and, in turn, the boundedness of Ung 
on ee So the sequence (Un, )xen 18 uniformly bounded by Theorem 1.1 and therefore 
the Morse index of uy, must keep bounded, in contradiction to our construction. 


PROOF OF THEOREM 1.2. Fixed k €N, we take, for any n € N, un = uj a critical point 
at level c? for the functional J’. First we use Lemma 4.14 and the analogous of (4.17) to 
have (un)nen bounded in Hy. The sequence (Uy)yncn, by Theorem 1.1, is then uniformly 
bounded, so by standard compactness arguments we can find a converging subsequence to 
a solution ux to (CP) at level cz, as follows from Lemma 4.14. By Lemma 4.15, we have 
infinitely many distinct values of cx, for k € N and so the proof is concluded. 


4.7. Multiple solutions to the problem on the whole domain 


This part is devoted to the proof of Theorem 1.4 which states the existence of infinitely 
many solutions to problem (P). 

Let us fix a sequence (rn)neN, ’n € R* such that rz, — +00 and consider the problems 
(P,) = (AP,,,) defined in Section 1.2. 

Beside the functional J defined in Section 1.2, we introduce the functional 


1 1 
mw =5 | (IWul? + a(su?) dx — = | |u|? dx, 
B,, (0) Br, (0) 


and the min—max levels 


cek= inf sup/(v) 
Ael,” veA 


and 


ce = inf supJ,(v), 
AerY" veA 


where Y is the natural constraint related to the functional J and V,, is the natural constraint 
related to J, or, equivalently, Vy, =VN Hy (B,,, (0)). 

Since (a) and (az) widely imply that (a — 5a..)~ = sup(—(a — 3do0),0) € LN’, we 
know that the eigenvalue problem 


—Au= ula _ Soo) (x)u in RY, 


(LP) 
uw H'(R), 
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has a diverging sequence of eigenvalues “1 < “2 < U3 <-+-+ << Un <---, See [30]. So 
we can find k such that zz; > 1. Also in this situation we have the analogous statement of 
Lemma 4.13. 

LEMMA 4.16. Jf uz > 1 then cg, > 0. 
PROOF. The proof is formally equal to that of Lemma 4.13, provided we take the func- 


tions gj as the eigenvectors given by (LP) corresponding to the eigenvalues jz; and 
E; = Span{¢1, ¢2,..., gj}. By the constraint equation, if ue VN Pas 


= (5-5) fy l™alea0) 
= (4) flr sae (o- be) 2) 
GNC Bhemte fe) 
AND = oa Lk] JRN RY 2 


1 1 1 
wi? > (5-2 )-—) fiers S fv 
2 p Uk] JRN 2 JIRN 
1 1 1 a 
> (5-2)((1- =) stu. + S13), (4.19) 


On the other hand, by the Hélder and Young inequalities, 


So 


s 2*(p—2 2*-2 2(2*— 2*-2 


2*(p — 2) rcs 2(2* — p) 
< lull + lla ll (4.20) 
PE PRD) 3 CORON 6 

Therefore, combining (4.19) and (4.20), one easily gets 


lu pl? < const: |lu|lp 


and finally, 


1 1 
I(u=(=-— i |u|? > const. 
2 Dp RN 


Since, for every A € rY, one has by Proposition 4.2 that AM Ee 4 U, by fixing u € 
AN Bey CVn | rae we have 


sup I > I(u) > const (4.21) 
A 
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and, taking the infimum, cz > const > 0. 
In this second case we always have 
Chey (4.22) 
because V, = VN Hy (B;,,) C V. Moreover, the property of Lemma 4.13 still holds. 


LEMMA 4.17. If ux > 1 then cy = lim, ch. 


PROOF. Let k be given and let A € pe Since A is a compact set, for every ¢ > 0 A has 
a finite e-net F contained in D(S2). For n large, F C Hy (B,,,). Let P, be the orthogonal 
projection of H' (RY) onto Hy (B,,,). We know that, for every x € A, ||x — Py(x)|| < e. 
Since A C VY, for v € P, (A), 


a(v) = (= [Vu = Jpn a(x)v2 dx 1/(p—2) es 
7 Jw |u|? dx , 


(4.23) 
provided « is taken sufficiently small. Then the map n,: A > H) (B,,) AV=Y, defined 
by 

Mn U+> a( Py (u)) Py (w) (4.24) 


is an odd map. So y*(mn(A)) > y*(A) > & and therefore, n,(A) € ‘algae One can also 
easily see that for any 5 > 0, by taking a conveniently small value of ¢ to have n, (A) close 
enough to A, 


ce < sup J <sup/ +6 (4.25) 
nn (A) A 


for n large. Taking the infimum for A € I; ys and 6 > 0 we finally find 


lim sup cz < cx, (4.26) 


n 


which, combined with (4.22), gives the thesis. 


We can also formally use the same proof of Lemma 4.13 to see that, also in this second 
case, the sequence cx is diverging. The same argument used for the proof of Theorem 1.2 
gives now Theorem 1.4. 


PROOF OF THEOREM 1.4. Let k be as in Lemma 4.16. For every n we can find a solu- 
tion uy to (P,) at level cy. Since 


1 1 
ch = 1,(un) = (5 = =) — Ck 
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as n — +00, then (un)yen is bounded in L”, so also 


is Van + faces < const 
R R 


and finally, 


1 1 7 
i= Vil? + Sa fl ur <const +f (a- a) ur 


1 — 4 (p/2)' 
< const + | (« a a) 


unl 
< const, 


SO (Un)neN 1S bounded in H!} (RY). Then by Theorem 1.3, (Un)nen has a converging sub- 
sequence to a solution uz to (P) at level cx. Since (cg) gen is diverging, (P) has infinitely 
many solutions. 


5. Concluding remarks 


We conclude this exposition with some comments on the assumptions employed for the 
two problems and indicating what one knows or what one can expect without them. In 
the second part of the section we shall show what kind of multiplicity results are already 
known for (SP) in nonsymmetric cases when the fundamental restriction N > 7 on the 
dimension is not assumed. 


5.1. Review on the assumptions and open problems 


We have considered the critical growth problem only from the point of view of taking into 
exam the presence of subcritical terms which make the concentrations to be not conve- 
nient. The techniques discussed here have no application (so far) to problems in which 
the concentrations are avoided thanks to assumptions on the shape of the domain or other 
geometric conditions. Easy extensions are possible to similar equations involving other 
operators as, for instance, the p-Laplacian or more general elliptic operators. The most 
delicate point is concerned with the bound on the dimension. The dimension seven has no 
particular meaning as happens, for instance, with the minimal surface problems, but de- 
pends on the linearity of the subcritical perturbation term Aw. A nonlinear subcritical term 
would require a different bound on the dimension. Let us point out that N > 4 is enough 
for the existence of a nontrivial solution for every 4 but three more dimensions are needed 
for the multiplicity results. The reason is due to the fact that as we have seen in Section 1.5, 
starting on dimension 4, the gain due to the quadratic term —A / 2 u? in the functional is 
more consistent than the cost of a cut-off term which brings a Talenti function to zero 
within the boundary of §2. On the other hand, if one wants to perform a similar test for the 
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multiplicity problem, one must cut off the function in order to reach a value of opposite 
sign and so the cost of the cut-off is considerably more expensive. 

As we have seen in Section 2, the existence of infinitely many solutions to (CP) is as- 
sured for every 2 C R% only for N > 7 and relies on a compactness theorem which cannot 
be extended to lower dimensions. This circumstance does not mean that the existence of in- 
finitely many solutions cannot be proved through different tools as it happens, for instance, 
in the case of symmetric domains (see [24]). Such a result is false if one looks for particular 
solutions as, if §2 is a ball, the radial ones (see [2]), which certainly exist if N > 7, and this 
suggests, in the general case, to search for solutions which change sign near the boundary, 
so excluding the radial symmetric functions. This approach was pursued in [14] in order to 
show the existence of two (pairs of ) distinct solutions for N > 4 and A <A}. 

A result in this sense will be shown in the second part of this section. 

In the case of problem (P) the assumptions (a1) and (az) let the superquadratic term of the 
functional bounded in terms of the quadratic part and allow the proof of Proposition 1.1. 
The smoothness asked in (a;) is more than what we need to this aim (a~ € L‘/?(R) 
would be more than enough) but it is required for the other assumptions. Condition (a3) is 
the equivalent of the bound N > 7 for (CP). The proof of the multiplicity results without 
this assumption would probably require completely different arguments. One can possibly 
show even uniqueness results in some particular cases, as happens for (CP) with the radial 
symmetry. On the contrary (a4) has been only used for the proof of Lemma 2.4 to the 
aim of passing from an integral of the function ag to an integral of ag It can certainly be 
weakened, the question if some assumption of this kind is necessary for the multiplicity 
result or what is the minimal condition is open. 


5.2. Estimates in lower dimension 


Now we shall prove, following [20], that the estimate in [14] increases up to at least x +1 
solutions or even to N + 1 if A is suitably close to zero. This result has been recently 
extended in [15] to the case A > A}. In any case, there is no reason to suppose that such a 
result may be optimal and the problem of proving the existence of infinitely many solutions, 
or even of getting an optimal estimate on the number of solutions, remain, as far as we 
know, largely open for N < 6. We shall work with the double natural constraint introduced 
in Section 4.4. 


LEMMA 5.1. Let (Un)nen be a PS sequence in W at level c < ZSNP, then the sequence 
cannot converge weakly to zero. 


PROOF. Since (Un)neN is a PS sequence in W and A €]0, A\[, we have ||Vu- || > const 


therefore an eventual strong limit of the two sequences (u> )neNn Cannot be zero. We have to 
extend this claim to the case of a weak limit, which brings a weaker information when the 
sequence is not compact. We know that the “bad” levels c for noncompact PS sequences 
detected by Theorem 1.6 in ]0, 2 SN arec=c'+ WSN? with c’ critical level for J, 
and the weak limit gp of the sequence is a solution u to (P) at level c’. The obstruction to 


the compactness of (Uy)nen iS given by scaled copies of a global solution g; which has a 
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constant sign and disappears if we restrict ourselves to u> for one of the + or — signs. So, 


n 
in one of the two cases, we have u>- — u~ strongly and so u ¥ 0, according to the assertion 


n 
in the beginning of the proof. Therefore or c or c — + S%/? is a nonnull critical level which 


corresponds to the strong or respectively to the weak limit of the sequence (Uy)nen. 


We set 
= inf J é 
on n(u) 
LEMMA 5.2. Forallk €{1,...,N+ 1}, we have 
2 
2c < cK < —S*”. 
co < ck W 


PROOF. The finite sequence of sets (I%)xe(1,...,N+1} i8 decreasing and therefore we must 
only prove that 2cg < cy and cy+1 < x SN /? The first inequality is obvious since, for 
all ue W, ut,u~ € V and Lu) = Lut) + I,(u~) = 2c. We start by determin- 
ing a constant ¢ < wen? such that cy < 2c, namely we can find a set A € Ty such 
that sup, I, < 2c < SN, Let B = Br be a ball with radius R > 0 contained in 
§2 which, in order to use a simpler notation, will be assumed, without any restriction, 
to be centered in the origin. For any v € SY~! = 4B, we consider two balls By and 
By of radius g contained in B and tangent to 0B respectively in v and in —v. Let 
us consider the function g:dB — W such that for any v € 0B, g(v) =u": 2 > R, 
where (u”)* and (u’)~ are respectively the function ux found in Section 1.5 in By 
and By and let us call ¢ = L.(u’)*) = 1,((u’)—). In this way, we map 0B into a set 
A C W in an odd continuous way, therefore y(A) > y(0B) = N. Moreover, Vv € 0B: 
Dw’) = b(u)t) + L(W")-) = 22 < HSN, 

From the bound cy < 2c we shall now pass to show that cy+1 is below aS: Actu- 
ally we shall find in this new case the bound cy+1 <¢+ xs N/2. by extending the above 
introduced map g from 0B to an N-dimensional sphere. From the construction in Sec- 
tion 1.5, one can easily see that w; can be modified continuously to the analogous function 
u}, which has a support on the ball B’(s) concentric with B/ and radius s, belongs to V 
and keeps the property J, (uj) < HSN. Of course h, (uy) > nN as s > 0. 

We shall firstly extend g to B, namely we shall find a continuous homotopy with values 
in W from ¢@ to a constant map. This homotopy will be performed in two steps. 

Firstly we shall shrink the radius of B) to a conveniently small radius p by taking 


Ay(s,v) = uy — U2 


with s € [0, R). Then we shall translate the balls B’(o) and By bringing the two centers 
on the origin, obtaining the homotopy 


Hy(t,v) =x a(x 4+1—) — a(x —1- 
2 2 
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for t € [0, 1]. 
The very different scales of Ti and uv make infinitesimal the mixed terms in the evalu- 
ation of J, so we have, for all t € [0, 1], 


1 
h(Aa(t, »)) = bf) + faa) + 219) = E+ FS"? +t erp), (5.1) 


where for i = 1, 2, €;(0) — 0 when p — 0. The definition of H2 should still be changed 
by multiplying the positive and the negative part of H2(t, v) by coefficients a(t) in such a 
way to provide that H2(t, v) € W for all t € [0, 1]. Since the function w+(f) are clearly con- 
tinuous and a+(t) > | as o — 0, as we can see by arguing as in (5.1), we still keep (5.1) 
after this small correction. H2(1, v) gives the same function whatever is v € 0B, so the 
homotopy connects ¢ to a constant map. 

We have in this way an extension of g to B and so to a hemisphere in dimension N + 1. 
By an odd extension we define ¢g on the whole sphere. 

Then the set of the functions obtained via this transformation is a compact symmetric 
set contained in WV whose genus is greater or equal to N + 1, moreover, on this set the 
functional J, is bounded by ¢ + yen + €2(p) < zSN? and the thesis follows. 


REMARK 5.1. If we work on the larger constraint V, we can add one more step to the 
previous construction showing that even the constrained level cy +2 is in such a case lower 
than xn /? Indeed, one can easily find a homotopy from the map ¢, extended to the 
sphere in N + | dimension to a constant map, by arguing as follows. For s € [0, 1] one 
performs the same construction as before by multiplying by s the function u* taken in 
By and then normalizing the whole u” by multiplying it by a normalization constant a(s) 
which lets a(s)u” € V. Analogously, one normalizes Hj (s, v). In this way we can, roughly 
speaking, “kill” the negative part of the function remaining only with scaled copies of 
u* on some balls contained in B. Then it is easy to modify such functions continuously 
reconducing all of them to the function u* defined as in Section 1.5 on the whole ball. This 
homotopy extends ¢ to a hemisphere in dimension N + 2. In any case, even with the present 
approach, we gain a further critical level by adding to the levels c}, c2,..., ck41 detected 
on W the level, which we have denoted by co, obtained as the infimum of J on VY, so that 
the difference apparently relies in a shift of the index which runs from 0 to N + 1 rather 
than from | to N + 2. However, the further information that, for i > 1, c; is a critical level 
corresponding to a PS sequence in W will allow the use of Lemma 5.1 and motivates the 
choice of working on the double natural constraint. Nevertheless, approaching the problem 
on Y would only give the further difficulty of avoiding the level W S/? in Lemma 5.1 and 
would finally lead to prove the same result as Theorem 5.1 in even dimension but to find 
one solution less in odd dimension. On the other hand, Theorem 5.2 can be proved also in 
this other way. 


We shall now observe that if two different levels c; coincide, then (P) must necessar- 
ily have infinitely many solutions, even if the [P.S.]-; condition fails. Note that this lack 
of compactness make us unable even to say that such a level must be critical, however 
Lemma 3.2 permits to conclude that the number of solutions at a possibly lower level is 
necessarily infinite. 
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LEMMA 5.3. If there exist i,j € {1,...,.N+1},i¥ j, such that cj = cj, then (P) has 
uncountably many solutions. 


PROOF. We can reduce ourselves to the case in which j =i+1 with i € {1,..., N}. 
We shall prove that, in this Hy Ones we can find a solution to (P) which is orthogonal 
to every given function v € Hy (2). Let (An YneN € [pM , be a minimizing sequence, i.e., 
lim sup, (sup 4, J.) = ci+1- Le. us fix v € Ae (2) and consider for every n EN 


Al =A, Nut. 


The sequence (A/,),en is, by Lemma 4.3, a sequence in Jj and, being 


lim 'sup(sup ih) < lim sup(sup h) =Ci41 =i, 
Al, n An 
it is a minimizing sequence. Let (Uy)nen be a constrained PS sequence at level c; close 
to the sequence (Aj )nen (i-e., lim, d(un, An) = 0), then by Lemma 5.1 its weak limit 
u is a nontrivial solution to (CP) which is orthogonal to v. If (CP) has a only countably 
many solutions, the set of the functions which are orthogonal to some solution to (CP) is 
a first category set. So we can find a function v € Hy (2) whose scalar product with every 
nontrivial solution is not null and we find a contradiction. 


THEOREM 5.1. Let N > 4, then (CP) has at least x + 1 distinct (pairs of) solutions 
VA €]0, Ai [. 


PROOF. Taking into account Lemma 5.3, we can suppose that Vi, j € {1,...,N+1}, cj) F 
cj so that we have N + 1 distinct levels c; fori =1,...,k + 1. Adding the ground state 
level cp, obtained as minimal level on V, we have N + 2 distinct levels 


2 
0<co <c] <-+++ <CN41 a 


By Lemma 3.2, we know that for every i € {1,..., N + 1} we have the following alterna- 
tive: or c; or C =Cj — oN /2 is a nonzero eal level, so we can deduce that ee most 
two different values c; can determine the same solution, so we get at least © NPs vy 1 
solutions to (CP). More precisely, when N is even we have at least © x +1 pairs “of Gautions 


to (CP) while if N is odd we get at least v x‘ 


+1 pairs of SolAtGAS to (CP). 


THEOREM 5.2. Let N >4, then there exists a positive number i €]0, A[ such that prob- 
lem (CP) has at least N + 1 distinct (pairs of) solutions for every  € 0 0, Af. 

PROOF. The proof is obvious taking into account that there exists 4 €]0, A;[ such that 
for all 4 €]0,A[ 2co > 7 S%/?. This last property implies that Vi € {2,...,N + 1}, 
Ge vs N/? < ¢1, so the only critical value which can be given by two different min-max 
approaches of the type considered above is co. 
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